Jul 09 14:01:48 devstack cinder-volume[75965]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 14:01:48 devstack cinder-volume[75965]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 14:01:48 devstack cinder-volume[75965]: we strongly recommend against using it for new projects. Jul 09 14:01:48 devstack cinder-volume[75965]: If you are already using Eventlet, we recommend migrating to a different Jul 09 14:01:48 devstack cinder-volume[75965]: framework. For more detail see Jul 09 14:01:48 devstack cinder-volume[75965]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 14:01:48 devstack cinder-volume[75965]: import eventlet # noqa Jul 09 14:01:51 devstack cinder-volume[75965]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75965) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 14:01:51 devstack cinder-volume[75965]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75965) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 14:01:51 devstack cinder-volume[75965]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75965) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 14:01:52 devstack cinder-volume[75965]: INFO dbcounter [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Registered counter for database cinder Jul 09 14:01:52 devstack cinder-volume[75965]: DEBUG oslo_db.sqlalchemy.engines [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75965) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 14:01:52 devstack cinder-volume[75965]: DEBUG dbcounter [-] [75965] Writer thread running {{(pid=75965) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 14:01:52 devstack cinder-volume[75965]: INFO cinder.rpc [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 14:01:52 devstack cinder-volume[75965]: INFO cinder.rpc [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 14:01:52 devstack cinder-volume[75965]: DEBUG oslo_db.sqlalchemy.engines [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75965) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 14:01:52 devstack cinder-volume[75965]: INFO cinder.volume.manager [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Determined volume DB was empty at startup. Jul 09 14:01:52 devstack cinder-volume[75965]: DEBUG cinder.volume.manager [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75965) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 14:01:52 devstack cinder-volume[75965]: INFO cinder.volume.manager [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 14:01:52 devstack cinder-volume[75965]: WARNING stevedore.named [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 14:01:52 devstack cinder-volume[75965]: WARNING castellan.key_manager [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 14:01:52 devstack cinder-volume[75965]: WARNING cinder.keymgr.conf_key_mgr [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 14:01:52 devstack cinder-volume[75965]: DEBUG cinder.volume.drivers.lvm [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75965) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 09 14:01:52 devstack cinder-volume[75965]: DEBUG oslo_concurrency.processutils [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75965) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_concurrency.processutils [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] CMD "cinder-rtstool verify" returned: 0 in 0.472s {{(pid=75965) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_db.sqlalchemy.engines [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75965) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 14:01:53 devstack cinder-volume[75965]: INFO cinder.rpc [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 09 14:01:53 devstack cinder-volume[75965]: INFO cinder.rpc [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 09 14:01:53 devstack cinder-volume[75965]: WARNING stevedore.named [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 14:01:53 devstack cinder-volume[75965]: WARNING castellan.key_manager [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 14:01:53 devstack cinder-volume[75965]: INFO cinder.volume.manager [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_db.sqlalchemy.engines [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75965) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 14:01:53 devstack cinder-volume[75965]: INFO oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Starting 1 workers Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Started child 76135 {{(pid=75965) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Full set of CONF: {{(pid=75965) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] ******************************************************************************** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Configuration options gathered from: {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] ================================================================================ {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] allow_availability_zone_fallback = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] allow_compression_on_image_upload = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[76135]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] allowed_direct_url_schemes = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] api_rate_limit = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] auth_strategy = keystone {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] az_cache_duration = 3600 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_availability_zone = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_host = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_stats_polling_interval = 60 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backup_api_class = cinder.backup.api.API {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backup_name_template = backup-%s {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backup_use_same_host = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backup_use_temp_snapshot = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] chap_password = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] chap_username = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cinder_internal_tenant_project_id = dcc7d81023d64598a80fce6db0251109 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cinder_internal_tenant_user_id = bb04c2fcb65b458e85371c351d67b325 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cloned_volume_same_az = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cluster = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] compression_format = gzip {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] compute_api_class = cinder.compute.nova.API {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] config_dir = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] config_source = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] control_exchange = openstack {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] debug = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] default_availability_zone = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] default_group_type = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] default_volume_type = lvmdriver-1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] disk_geometry = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] driver_client_cert = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] driver_client_cert_key = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] driver_data_namespace = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] driver_ssl_cert_path = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] driver_ssl_cert_verify = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] driver_use_ssl = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] enable_force_upload = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] enable_new_services = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] enable_unsupported_driver = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] enforce_multipath_for_image_xfer = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] filter_function = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance_api_insecure = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance_api_servers = ['http://192.168.122.68/image'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance_api_ssl_compression = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance_ca_certificates_file = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance_catalog_info = image:glance:publicURL {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance_certfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance_keyfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[76135]: INFO cinder.volume.manager [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 09 14:01:53 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance_num_retries = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance_request_timeout = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] goodness_function = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] graceful_shutdown_timeout = 5 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] group_api_class = cinder.group.api.API {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] host = devstack {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] image_compress_on_upload = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] image_conversion_address_space_limit = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] image_conversion_cpu_limit = 60 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] image_conversion_disable = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] image_upload_use_cinder_backend = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] image_upload_use_internal_tenant = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] image_volume_cache_enabled = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] image_volume_cache_max_count = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] image_volume_cache_max_size_gb = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] init_host_max_objects_retrieval = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] instance_format = [instance: %(uuid)s] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] iscsi_target_flags = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] iscsi_write_cache = on {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] iser_helper = tgtadm {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] iser_ip_address = 192.168.122.68 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] iser_port = 3260 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] log_color = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] log_config_append = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] log_dir = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] log_file = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] log_options = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] log_rotate_interval = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] log_rotate_interval_type = days {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] log_rotation_type = none {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] max_age = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] max_logfile_count = 30 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] max_logfile_size_mb = 200 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] max_over_subscription_ratio = 20.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] message_reap_interval = 86400 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] message_ttl = 2592000 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] migration_create_volume_timeout_secs = 300 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] monkey_patch = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] monkey_patch_modules = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] my_ip = 192.168.122.68 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] no_snapshot_gb_quota = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] num_iser_scan_tries = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] num_shell_tries = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] num_volume_device_scan_tries = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] nvmeof_conn_info_version = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] nvmet_ns_id = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] nvmet_port_id = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] osapi_max_limit = 1000 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] osapi_volume_ext_list = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] osapi_volume_listen_port = 8776 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] osapi_volume_use_ssl = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] osapi_volume_workers = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] per_volume_size_limit = -1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] periodic_fuzzy_delay = 60 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] periodic_interval = 60 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] public_endpoint = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] publish_errors = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] quota_backup_gigabytes = 1000 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] quota_backups = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] quota_gigabytes = 1000 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] quota_groups = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] quota_snapshots = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] quota_volumes = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] rate_limit_burst = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] rate_limit_except_level = CRITICAL {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] rate_limit_interval = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] reinit_driver_count = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] replication_device = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] report_discard_supported = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] report_interval = 120 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] reservation_clean_interval = 86400 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] reservation_expire = 86400 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] reserved_image_namespaces = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] reserved_percentage = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] rpc_response_timeout = 120 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] run_external_periodic_tasks = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] scst_target_driver = iscsi {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] scst_target_iqn_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] service_down_time = 720 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] shell_completion = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] snapshot_name_template = snapshot-%s {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] snapshot_same_host = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] split_loggers = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] state_path = /opt/stack/data/cinder {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] storage_availability_zone = nova {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] storage_protocol = iSCSI {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] syslog_log_facility = LOG_USER {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] target_helper = lioadm {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] target_ip_address = 192.168.122.68 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] target_port = 3260 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] target_protocol = iscsi {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] target_secondary_ip_addresses = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] trace_flags = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] transport_url = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] until_refresh = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] use_chap_auth = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] use_default_quota_class = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] use_journal = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] use_json = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] use_multipath_for_image_xfer = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] use_stderr = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] use_syslog = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] verify_glance_signatures = enabled {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] volume_api_class = cinder.volume.api.API {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] volume_backend_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] volume_clear = zero {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] volume_clear_ionice = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] volume_clear_size = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] volume_copy_bps_limit = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] volume_dd_blocksize = 1M {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] volume_name_template = volume-%s {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] volume_service_inithost_offload = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] volume_usage_audit_period = month {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] zoning_mode = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_concurrency.disable_process_locking = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.auth_section = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.auth_type = password {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.auth_version = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.cache = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.054s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:01:53 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.certfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.include_service_catalog = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.insecure = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.interface = public {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.keyfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.memcache_password = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.memcache_username = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.region_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.service_type = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.68/identity {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.backend = dogpile.cache.null {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.backend_argument = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.backend_expiration_time = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.config_prefix = cache.oslo {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.debug_cache_backend = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.enable_retry_client = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.enable_socket_keepalive = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.enabled = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.expiration_time = 600 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.hashclient_retry_attempts = 2 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.memcache_dead_retry = 300 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.memcache_pool_maxsize = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.memcache_sasl_enabled = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.password = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.proxies = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.redis_db = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.redis_server = localhost:6379 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.retry_attempts = 2 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.retry_delay = 0.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.socket_keepalive_count = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.socket_keepalive_idle = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.socket_keepalive_interval = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.socket_timeout = 1.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.tls_allowed_ciphers = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.tls_cafile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.tls_certfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.tls_enabled = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.tls_keyfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cache.username = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.asyncio_connection = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.asyncio_slave_connection = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.backend = sqlalchemy {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.connection = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.connection_debug = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.connection_parameters = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.connection_recycle_time = 3600 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.connection_trace = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.db_inc_retry_interval = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.db_max_retries = 20 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.db_max_retry_interval = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.db_retry_interval = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.max_overflow = 50 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.max_pool_size = 5 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.max_retries = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.mysql_wsrep_sync_wait = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.pool_timeout = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.retry_interval = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.slave_connection = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.sqlite_synchronous = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.synchronous_reader = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] database.use_db_reconnect = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] profiler.connection_string = messaging:// {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] profiler.enabled = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack sudo[76140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] profiler.es_doc_type = notification {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack sudo[76140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] profiler.es_scroll_size = 10000 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] profiler.es_scroll_time = 2m {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] profiler.filter_error_trace = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] profiler.hmac_keys = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] profiler.sentinel_service_name = mymaster {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] profiler.socket_timeout = 0.1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] profiler.trace_requests = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] profiler.trace_sqlalchemy = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] profiler_jaeger.process_tags = {} {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] profiler_jaeger.service_name_prefix = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] profiler_otlp.service_name_prefix = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_policy.enforce_new_defaults = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_policy.enforce_scope = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_policy.policy_default_rule = default {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_policy.policy_file = policy.yaml {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] coordination.backend_url = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] privsep_osbrick.group = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] privsep_osbrick.helper_command = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] privsep_osbrick.user = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cinder_sys_admin.group = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cinder_sys_admin.helper_command = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] cinder_sys_admin.user = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] service_user.auth_section = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] service_user.auth_type = password {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] service_user.cafile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] service_user.certfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] service_user.collect_timing = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] service_user.insecure = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] service_user.keyfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] service_user.send_service_user_token = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] service_user.split_loggers = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] service_user.timeout = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance.auth_section = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance.auth_type = password {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance.certfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance.collect_timing = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance.insecure = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance.keyfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance.region_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance.split_loggers = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] glance.timeout = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.backend_availability_zone = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.chap_password = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.chap_username = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.disk_geometry = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.driver_client_cert = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.driver_client_cert_key = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.driver_data_namespace = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.driver_use_ssl = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.extra_capabilities = {} {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.filter_function = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.goodness_function = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.iscsi_target_flags = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.iscsi_write_cache = on {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.iser_helper = tgtadm {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.iser_ip_address = 192.168.122.68 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.iser_port = 3260 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.lvm_share_target = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.lvm_type = auto {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.num_shell_tries = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.replication_device = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.report_discard_supported = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.reserved_percentage = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.target_helper = tgtadm {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.target_ip_address = 192.168.122.68 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.target_port = 3260 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.target_protocol = iscsi {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.trace_flags = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.unique_fqdn_network = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.use_chap_auth = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.volume_backend_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.volume_clear = zero {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.volume_clear_ionice = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.volume_clear_size = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_reports.file_event_handler = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_reports.log_dir = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.backend_host = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.chap_password = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.chap_username = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.disk_geometry = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.driver_client_cert = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.extra_capabilities = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.filter_function = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.goodness_function = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.iser_helper = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.iser_ip_address = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.iser_port = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.lvm_share_target = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.lvm_type = auto {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.num_shell_tries = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.replication_device = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.report_discard_supported = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.reserved_percentage = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.scst_target_driver = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.storage_protocol = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.target_helper = lioadm {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.target_ip_address = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.target_port = 3260 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.trace_flags = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.use_chap_auth = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.volume_clear = zero {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.volume_clear_size = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] lvmdriver-1.volumes_dir = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.ssl = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_notifications.driver = [] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_notifications.retry = -1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] key_manager.fixed_key = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican.barbican_api_version = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican.barbican_endpoint = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican.barbican_endpoint_type = public {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican.barbican_region_name = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican.cafile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican.certfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican.collect_timing = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican.insecure = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican.keyfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican.number_of_retries = 60 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican.retry_delay = 1 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican.send_service_user_token = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican.split_loggers = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican.timeout = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican.verify_ssl = True {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican.verify_ssl_path = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican_service_user.auth_section = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican_service_user.auth_type = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican_service_user.cafile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican_service_user.certfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican_service_user.collect_timing = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican_service_user.insecure = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican_service_user.keyfile = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican_service_user.split_loggers = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] barbican_service_user.timeout = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] vault.approle_role_id = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] vault.approle_secret_id = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] vault.kv_mountpoint = secret {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] vault.kv_path = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] vault.kv_version = 2 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] vault.namespace = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] vault.root_token_id = **** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] vault.ssl_ca_crt_file = None {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] vault.timeout = 60.0 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] vault.use_ssl = False {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:01:53 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] ******************************************************************************** {{(pid=75965) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 14:01:54 devstack sudo[76140]: pam_unix(sudo:session): session closed for user root Jul 09 14:01:54 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.754s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:01:54 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:01:54 devstack sudo[76269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:01:54 devstack sudo[76269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:01:55 devstack sudo[76269]: pam_unix(sudo:session): session closed for user root Jul 09 14:01:55 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.685s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:01:55 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:01:55 devstack cinder-volume[76135]: INFO cinder.brick.local_dev.lvm [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 09 14:01:55 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:01:55 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:01:55 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:01:55 devstack sudo[76507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 14:01:55 devstack sudo[76507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:01:55 devstack sudo[76507]: pam_unix(sudo:session): session closed for user root Jul 09 14:01:55 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:01:55 devstack cinder-volume[76135]: DEBUG cinder.brick.local_dev.lvm [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76135) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 09 14:01:55 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:01:55 devstack sudo[76705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:01:55 devstack sudo[76705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:01:56 devstack sudo[76705]: pam_unix(sudo:session): session closed for user root Jul 09 14:01:56 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.129s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:01:56 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:01:56 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:01:56 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:01:56 devstack sudo[76913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:01:56 devstack sudo[76913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:01:57 devstack sudo[76913]: pam_unix(sudo:session): session closed for user root Jul 09 14:01:57 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.794s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:01:57 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:01:57 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:01:57 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:01:57 devstack sudo[76919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 09 14:01:57 devstack sudo[76919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:01:58 devstack sudo[76919]: pam_unix(sudo:session): session closed for user root Jul 09 14:01:58 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.728s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:01:58 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:01:58 devstack sudo[76923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 14:01:58 devstack sudo[76923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:01:59 devstack sudo[76923]: pam_unix(sudo:session): session closed for user root Jul 09 14:01:59 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.720s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:01:59 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:01:59 devstack sudo[76934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 14:01:59 devstack sudo[76934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:01:59 devstack sudo[76934]: pam_unix(sudo:session): session closed for user root Jul 09 14:01:59 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:01:59 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:01:59 devstack sudo[76938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:01:59 devstack sudo[76938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:02:00 devstack sudo[76938]: pam_unix(sudo:session): session closed for user root Jul 09 14:02:00 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.889s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:02:00 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:02:00 devstack sudo[76945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:02:00 devstack sudo[76945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:02:01 devstack sudo[76945]: pam_unix(sudo:session): session closed for user root Jul 09 14:02:01 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.741s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:02:01 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:02:01 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:02:01 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:02:01 devstack sudo[76954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:02:01 devstack sudo[76954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:02:02 devstack sudo[76954]: pam_unix(sudo:session): session closed for user root Jul 09 14:02:02 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.674s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:02:02 devstack cinder-volume[76135]: INFO cinder.volume.drivers.lvm [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 09 14:02:02 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:02:02 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:02:02 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:02:02 devstack sudo[76963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:02:02 devstack sudo[76963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:02:02 devstack sudo[76963]: pam_unix(sudo:session): session closed for user root Jul 09 14:02:02 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.754s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:02:02 devstack cinder-volume[76135]: DEBUG cinder.volume.drivers.lvm [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Updating volume stats {{(pid=76135) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 14:02:02 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:02:02 devstack sudo[77080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 14:02:02 devstack sudo[77080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:02:03 devstack cinder-volume[75965]: DEBUG dbcounter [-] [75965] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75965) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:02:03 devstack sudo[77080]: pam_unix(sudo:session): session closed for user root Jul 09 14:02:03 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:02:03 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:02:03 devstack sudo[77096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:02:03 devstack sudo[77096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:02:04 devstack sudo[77096]: pam_unix(sudo:session): session closed for user root Jul 09 14:02:04 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:02:04 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:02:04 devstack sudo[77224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:02:04 devstack sudo[77224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:02:04 devstack sudo[77224]: pam_unix(sudo:session): session closed for user root Jul 09 14:02:04 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.678s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:02:04 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:02:04 devstack sudo[77227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:02:04 devstack sudo[77227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:02:05 devstack sudo[77227]: pam_unix(sudo:session): session closed for user root Jul 09 14:02:05 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:02:05 devstack cinder-volume[76135]: INFO cinder.volume.driver [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 14:02:05 devstack cinder-volume[76135]: DEBUG cinder.volume.driver [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76135) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 14:02:05 devstack cinder-volume[76135]: DEBUG oslo_db.sqlalchemy.engines [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76135) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 14:02:05 devstack cinder-volume[76135]: DEBUG dbcounter [-] [76135] Writer thread running {{(pid=76135) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 14:02:05 devstack cinder-volume[76135]: DEBUG cinder.db.sqlalchemy.api [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Building query based on filter {{(pid=76135) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jul 09 14:02:05 devstack cinder-volume[76135]: DEBUG cinder.image.image_utils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76135) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 14:02:05 devstack cinder-volume[76135]: INFO cinder.keymgr.migration [None req-d1f7ba01-85c1-47ca-a5cc-5be1f3057acd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 14:02:05 devstack cinder-volume[76135]: DEBUG cinder.volume.drivers.lvm [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Updating volume stats {{(pid=76135) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 14:02:05 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:02:05 devstack sudo[77232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 14:02:05 devstack sudo[77232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:02:06 devstack sudo[77232]: pam_unix(sudo:session): session closed for user root Jul 09 14:02:06 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.747s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:02:06 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:02:06 devstack sudo[77239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:02:06 devstack sudo[77239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:02:07 devstack sudo[77239]: pam_unix(sudo:session): session closed for user root Jul 09 14:02:07 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.695s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:02:07 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:02:07 devstack sudo[77242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:02:07 devstack sudo[77242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:02:07 devstack sudo[77242]: pam_unix(sudo:session): session closed for user root Jul 09 14:02:07 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:02:07 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:02:07 devstack sudo[77245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:02:07 devstack sudo[77245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:02:08 devstack sudo[77245]: pam_unix(sudo:session): session closed for user root Jul 09 14:02:08 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.691s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:02:08 devstack cinder-volume[76135]: DEBUG cinder.manager [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Notifying Schedulers of capabilities ... {{(pid=76135) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:02:08 devstack cinder-volume[76135]: INFO cinder.volume.manager [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Driver initialization completed successfully. Jul 09 14:02:08 devstack cinder-volume[76135]: INFO cinder.manager [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Initiating service 2 cleanup Jul 09 14:02:08 devstack cinder-volume[76135]: INFO cinder.manager [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Service 2 cleanup completed. Jul 09 14:02:08 devstack cinder-volume[76135]: DEBUG cinder.service [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Creating RPC server for service cinder-volume {{(pid=76135) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 14:02:08 devstack cinder-volume[76135]: DEBUG cinder.service [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76135) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 14:02:08 devstack cinder-volume[76135]: INFO cinder.volume.manager [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 09 14:02:08 devstack cinder-volume[76135]: DEBUG cinder.volume.drivers.lvm [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Updating volume stats {{(pid=76135) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 14:02:08 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:02:08 devstack sudo[77249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 14:02:08 devstack sudo[77249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:02:09 devstack sudo[77249]: pam_unix(sudo:session): session closed for user root Jul 09 14:02:09 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.732s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:02:09 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:02:09 devstack sudo[77253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:02:09 devstack sudo[77253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:02:10 devstack sudo[77253]: pam_unix(sudo:session): session closed for user root Jul 09 14:02:10 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.709s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:02:10 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:02:10 devstack sudo[77265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:02:10 devstack sudo[77265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:02:10 devstack sudo[77265]: pam_unix(sudo:session): session closed for user root Jul 09 14:02:10 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.655s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:02:10 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:02:10 devstack sudo[77323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:02:10 devstack sudo[77323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:02:11 devstack sudo[77323]: pam_unix(sudo:session): session closed for user root Jul 09 14:02:11 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:02:11 devstack cinder-volume[76135]: INFO cinder.volume.manager [None req-9177fce0-f178-4a97-9826-091ad4b36528 None None] Driver post RPC initialization completed successfully. Jul 09 14:02:21 devstack cinder-volume[76135]: DEBUG dbcounter [-] [76135] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76135) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:02:21 devstack cinder-volume[76135]: DEBUG dbcounter [-] [76135] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76135) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:02:40 devstack cinder-volume[76135]: DEBUG oslo_service.periodic_task [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running periodic task VolumeManager._thread_info {{(pid=76135) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:02:40 devstack cinder-volume[76135]: DEBUG cinder.volume.manager [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] thread count: 6 {{(pid=76135) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:02:40 devstack cinder-volume[76135]: DEBUG cinder.volume.manager [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] thread info: [<_MainThread(MainThread, started 126283862741120)>, , , , , ] {{(pid=76135) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:03:40 devstack cinder-volume[76135]: DEBUG oslo_service.periodic_task [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76135) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:03:40 devstack cinder-volume[76135]: DEBUG cinder.volume.drivers.lvm [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Updating volume stats {{(pid=76135) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 14:03:40 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:03:40 devstack sudo[82166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 14:03:40 devstack sudo[82166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:03:41 devstack sudo[82166]: pam_unix(sudo:session): session closed for user root Jul 09 14:03:41 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:03:41 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:03:41 devstack sudo[82173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:03:41 devstack sudo[82173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:03:41 devstack sudo[82173]: pam_unix(sudo:session): session closed for user root Jul 09 14:03:41 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:03:41 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:03:41 devstack sudo[82176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:03:41 devstack sudo[82176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:03:42 devstack sudo[82176]: pam_unix(sudo:session): session closed for user root Jul 09 14:03:42 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.625s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:03:42 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:03:42 devstack sudo[82179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:03:42 devstack sudo[82179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:03:42 devstack sudo[82179]: pam_unix(sudo:session): session closed for user root Jul 09 14:03:42 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:03:42 devstack cinder-volume[76135]: DEBUG cinder.manager [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Notifying Schedulers of capabilities ... {{(pid=76135) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:03:42 devstack cinder-volume[76135]: DEBUG oslo_service.periodic_task [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running periodic task VolumeManager._thread_info {{(pid=76135) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:03:42 devstack cinder-volume[76135]: DEBUG cinder.volume.manager [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] thread count: 6 {{(pid=76135) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:03:42 devstack cinder-volume[76135]: DEBUG cinder.volume.manager [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] thread info: [<_MainThread(MainThread, started 126283862741120)>, , , , , ] {{(pid=76135) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:04:21 devstack cinder-volume[76135]: DEBUG dbcounter [-] [76135] Writing DB stats cinder:SELECT=1 {{(pid=76135) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:04:21 devstack cinder-volume[76135]: DEBUG dbcounter [-] [76135] Writing DB stats cinder:UPDATE=1 {{(pid=76135) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:04:40 devstack cinder-volume[76135]: DEBUG oslo_service.periodic_task [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76135) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:04:40 devstack cinder-volume[76135]: DEBUG cinder.volume.drivers.lvm [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Updating volume stats {{(pid=76135) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 14:04:40 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:04:40 devstack sudo[83674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 14:04:40 devstack sudo[83674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:04:41 devstack sudo[83674]: pam_unix(sudo:session): session closed for user root Jul 09 14:04:41 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:04:41 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:04:41 devstack sudo[83687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:04:41 devstack sudo[83687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:04:41 devstack sudo[83687]: pam_unix(sudo:session): session closed for user root Jul 09 14:04:41 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:04:41 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:04:41 devstack sudo[83718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:04:41 devstack sudo[83718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:04:42 devstack sudo[83718]: pam_unix(sudo:session): session closed for user root Jul 09 14:04:42 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.620s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:04:42 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:04:42 devstack sudo[83747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:04:42 devstack sudo[83747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:04:43 devstack sudo[83747]: pam_unix(sudo:session): session closed for user root Jul 09 14:04:43 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:04:43 devstack cinder-volume[76135]: DEBUG cinder.manager [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Notifying Schedulers of capabilities ... {{(pid=76135) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:04:43 devstack cinder-volume[76135]: DEBUG oslo_service.periodic_task [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running periodic task VolumeManager._thread_info {{(pid=76135) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:04:43 devstack cinder-volume[76135]: DEBUG cinder.volume.manager [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] thread count: 6 {{(pid=76135) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:04:43 devstack cinder-volume[76135]: DEBUG cinder.volume.manager [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] thread info: [<_MainThread(MainThread, started 126283862741120)>, , , , , ] {{(pid=76135) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:05:40 devstack cinder-volume[76135]: DEBUG oslo_service.periodic_task [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76135) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:05:40 devstack cinder-volume[76135]: DEBUG cinder.volume.drivers.lvm [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Updating volume stats {{(pid=76135) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 14:05:40 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:05:40 devstack sudo[85162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 14:05:40 devstack sudo[85162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:05:41 devstack sudo[85162]: pam_unix(sudo:session): session closed for user root Jul 09 14:05:41 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:05:41 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:05:41 devstack sudo[85181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:05:41 devstack sudo[85181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:05:41 devstack sudo[85181]: pam_unix(sudo:session): session closed for user root Jul 09 14:05:41 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:05:41 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:05:41 devstack sudo[85196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 14:05:41 devstack sudo[85196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:05:42 devstack sudo[85196]: pam_unix(sudo:session): session closed for user root Jul 09 14:05:42 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.600s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:05:42 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:05:42 devstack sudo[85201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 14:05:42 devstack sudo[85201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:05:42 devstack sudo[85201]: pam_unix(sudo:session): session closed for user root Jul 09 14:05:42 devstack cinder-volume[76135]: DEBUG oslo_concurrency.processutils [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=76135) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:05:42 devstack cinder-volume[76135]: DEBUG cinder.manager [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Notifying Schedulers of capabilities ... {{(pid=76135) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:05:42 devstack cinder-volume[76135]: DEBUG oslo_service.periodic_task [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] Running periodic task VolumeManager._thread_info {{(pid=76135) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:05:42 devstack cinder-volume[76135]: DEBUG cinder.volume.manager [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] thread count: 6 {{(pid=76135) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:05:42 devstack cinder-volume[76135]: DEBUG cinder.volume.manager [None req-a043fe3b-349a-4d64-a284-517a7132c6ce None None] thread info: [<_MainThread(MainThread, started 126283862741120)>, , , , , ] {{(pid=76135) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:06:21 devstack cinder-volume[76135]: DEBUG dbcounter [-] [76135] Writing DB stats cinder:SELECT=1 {{(pid=76135) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:06:21 devstack cinder-volume[76135]: DEBUG dbcounter [-] [76135] Writing DB stats cinder:UPDATE=1 {{(pid=76135) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:06:23 devstack cinder-volume[75965]: INFO oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Caught SIGTERM, stopping children Jul 09 14:06:23 devstack cinder-volume[75965]: DEBUG oslo_concurrency.lockutils [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Acquiring lock "singleton_lock" {{(pid=75965) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 14:06:23 devstack cinder-volume[75965]: DEBUG oslo_concurrency.lockutils [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Acquired lock "singleton_lock" {{(pid=75965) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 14:06:23 devstack cinder-volume[75965]: DEBUG oslo_concurrency.lockutils [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Releasing lock "singleton_lock" {{(pid=75965) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 14:06:23 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Stop services. {{(pid=75965) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 14:06:23 devstack cinder-volume[75965]: DEBUG oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Killing children. {{(pid=75965) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 14:06:23 devstack cinder-volume[75965]: INFO oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Waiting on 1 children to exit Jul 09 14:06:23 devstack cinder-volume[76135]: DEBUG oslo_concurrency.lockutils [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Acquiring lock "singleton_lock" {{(pid=76135) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 14:06:23 devstack cinder-volume[76135]: DEBUG oslo_concurrency.lockutils [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Acquired lock "singleton_lock" {{(pid=76135) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 14:06:23 devstack cinder-volume[76135]: DEBUG oslo_concurrency.lockutils [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Releasing lock "singleton_lock" {{(pid=76135) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 14:06:23 devstack cinder-volume[76135]: WARNING amqp [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 14:06:23 devstack cinder-volume[76135]: WARNING amqp [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 14:06:23 devstack cinder-volume[75965]: INFO oslo_service.backend._eventlet.service [None req-b1b3e577-f7d8-42ef-883b-dade9747aa00 None None] Child 76135 exited with status 0 Jul 09 14:06:24 devstack cinder-volume[86224]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 14:06:24 devstack cinder-volume[86224]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 14:06:24 devstack cinder-volume[86224]: we strongly recommend against using it for new projects. Jul 09 14:06:24 devstack cinder-volume[86224]: If you are already using Eventlet, we recommend migrating to a different Jul 09 14:06:24 devstack cinder-volume[86224]: framework. For more detail see Jul 09 14:06:24 devstack cinder-volume[86224]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 14:06:24 devstack cinder-volume[86224]: import eventlet # noqa Jul 09 14:06:26 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86224) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 14:06:26 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86224) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 14:06:26 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86224) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 14:06:26 devstack cinder-volume[86224]: INFO dbcounter [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Registered counter for database cinder Jul 09 14:06:26 devstack cinder-volume[86224]: DEBUG oslo_db.sqlalchemy.engines [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86224) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG dbcounter [-] [86224] Writer thread running {{(pid=86224) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 14:06:27 devstack cinder-volume[86224]: INFO cinder.rpc [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 14:06:27 devstack cinder-volume[86224]: INFO cinder.rpc [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_db.sqlalchemy.engines [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86224) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 14:06:27 devstack cinder-volume[86224]: INFO cinder.volume.manager [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Determined volume DB was empty at startup. Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG cinder.volume.manager [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86224) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 14:06:27 devstack cinder-volume[86224]: INFO cinder.volume.manager [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 14:06:27 devstack cinder-volume[86224]: WARNING stevedore.named [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 14:06:27 devstack cinder-volume[86224]: WARNING castellan.key_manager [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 14:06:27 devstack cinder-volume[86224]: WARNING cinder.keymgr.conf_key_mgr [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 14:06:27 devstack cinder-volume[86224]: INFO cinder.volume.manager [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_db.sqlalchemy.engines [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86224) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 14:06:27 devstack cinder-volume[86224]: INFO oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Starting 1 workers Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Started child 86440 {{(pid=86224) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Full set of CONF: {{(pid=86224) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] ******************************************************************************** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Configuration options gathered from: {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] ================================================================================ {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] allow_availability_zone_fallback = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] allow_compression_on_image_upload = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86440]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] allowed_direct_url_schemes = [] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] api_rate_limit = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] auth_strategy = keystone {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_availability_zone = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_host = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_name = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_stats_polling_interval = 60 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backup_api_class = cinder.backup.api.API {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backup_name_template = backup-%s {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backup_use_same_host = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backup_use_temp_snapshot = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] chap_password = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] chap_username = {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cinder_internal_tenant_project_id = dcc7d81023d64598a80fce6db0251109 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cinder_internal_tenant_user_id = bb04c2fcb65b458e85371c351d67b325 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cluster = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] compression_format = gzip {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] compute_api_class = cinder.compute.nova.API {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] config_dir = [] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] config_source = [] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] control_exchange = openstack {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] debug = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] default_availability_zone = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] default_group_type = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] default_volume_type = QuobyteHD {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] disk_geometry = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] driver_client_cert = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] driver_client_cert_key = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] driver_data_namespace = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] driver_ssl_cert_path = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] driver_ssl_cert_verify = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] driver_use_ssl = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] enable_new_services = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] enable_unsupported_driver = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] enabled_backends = ['QuobyteHD'] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] enforce_multipath_for_image_xfer = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] filter_function = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance_api_insecure = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance_api_servers = ['http://192.168.122.68/image'] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance_api_ssl_compression = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance_ca_certificates_file = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance_catalog_info = image:glance:publicURL {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance_certfile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance_keyfile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance_num_retries = 3 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance_request_timeout = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] goodness_function = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] graceful_shutdown_timeout = 5 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] group_api_class = cinder.group.api.API {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] host = devstack {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] image_compress_on_upload = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] image_conversion_address_space_limit = 1 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] image_conversion_cpu_limit = 60 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] image_conversion_disable = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] image_upload_use_cinder_backend = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] image_upload_use_internal_tenant = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] image_volume_cache_enabled = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] image_volume_cache_max_count = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] image_volume_cache_max_size_gb = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] init_host_max_objects_retrieval = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] instance_format = [instance: %(uuid)s] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] iscsi_target_flags = {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] iscsi_write_cache = on {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] iser_helper = tgtadm {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] iser_ip_address = 192.168.122.68 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] iser_port = 3260 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] log_color = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] log_config_append = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] log_dir = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] log_file = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86440]: INFO cinder.volume.manager [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 14:06:27 devstack cinder-volume[86440]: DEBUG cinder.volume.drivers.remotefs [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86440) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] log_options = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] log_rotate_interval = 1 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] log_rotate_interval_type = days {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] log_rotation_type = none {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] max_age = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] max_logfile_count = 30 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] max_logfile_size_mb = 200 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] max_over_subscription_ratio = 20.0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] message_reap_interval = 86400 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] message_ttl = 2592000 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] migration_create_volume_timeout_secs = 300 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] monkey_patch = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] monkey_patch_modules = [] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] my_ip = 192.168.122.68 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] no_snapshot_gb_quota = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] num_iser_scan_tries = 3 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] num_shell_tries = 3 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] num_volume_device_scan_tries = 3 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] nvmeof_conn_info_version = 1 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] nvmet_ns_id = 10 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] nvmet_port_id = 1 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] osapi_max_limit = 1000 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] osapi_volume_ext_list = [] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] osapi_volume_listen_port = 8776 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] osapi_volume_use_ssl = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] osapi_volume_workers = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] per_volume_size_limit = -1 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] periodic_fuzzy_delay = 60 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] periodic_interval = 60 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] public_endpoint = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] publish_errors = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] quota_backup_gigabytes = 1000 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] quota_backups = 10 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] quota_gigabytes = 1000 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] quota_groups = 10 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] quota_snapshots = 10 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] quota_volumes = 10 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] rate_limit_burst = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] rate_limit_except_level = CRITICAL {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] rate_limit_interval = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] reinit_driver_count = 3 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] replication_device = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] report_discard_supported = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] report_interval = 120 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] reservation_clean_interval = 86400 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] reservation_expire = 86400 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] reserved_image_namespaces = [] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] reserved_percentage = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] rpc_response_timeout = 120 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] run_external_periodic_tasks = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] scst_target_driver = iscsi {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] scst_target_iqn_name = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] service_down_time = 720 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] shell_completion = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] snapshot_name_template = snapshot-%s {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] split_loggers = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] state_path = /opt/stack/data/cinder {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] storage_availability_zone = nova {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] storage_protocol = iSCSI {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] syslog_log_facility = LOG_USER {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] target_helper = lioadm {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] target_ip_address = 192.168.122.68 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] target_port = 3260 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] target_protocol = iscsi {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] target_secondary_ip_addresses = [] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] trace_flags = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] transport_url = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] until_refresh = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] use_chap_auth = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] use_default_quota_class = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] use_journal = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] use_json = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] use_multipath_for_image_xfer = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] use_stderr = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] use_syslog = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] verify_glance_signatures = enabled {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] volume_api_class = cinder.volume.api.API {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] volume_backend_name = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] volume_clear = zero {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] volume_clear_ionice = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] volume_clear_size = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] volume_copy_bps_limit = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] volume_dd_blocksize = 1M {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] volume_name_template = volume-%s {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] volume_service_inithost_offload = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] volume_usage_audit_period = month {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] zoning_mode = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_concurrency.disable_process_locking = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.auth_section = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.auth_type = password {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.auth_version = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.cache = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.certfile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.include_service_catalog = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.insecure = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.interface = public {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.keyfile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.memcache_password = {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.memcache_username = {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.region_name = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.service_type = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.68/identity {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86440]: DEBUG cinder.volume.drivers.quobyte [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86440) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 14:06:27 devstack cinder-volume[86440]: WARNING cinder.volume.drivers.quobyte [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 14:06:27 devstack cinder-volume[86440]: WARNING cinder.volume.drivers.quobyte [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.backend = dogpile.cache.null {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.backend_argument = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.backend_expiration_time = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.config_prefix = cache.oslo {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.debug_cache_backend = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.enable_retry_client = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86440]: DEBUG oslo_concurrency.processutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Running cmd (subprocess): mount.quobyte {{(pid=86440) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.enable_socket_keepalive = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.enabled = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.expiration_time = 600 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.hashclient_retry_attempts = 2 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.memcache_dead_retry = 300 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.memcache_pool_maxsize = 10 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.memcache_sasl_enabled = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.password = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.proxies = [] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.redis_db = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.redis_server = localhost:6379 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.retry_attempts = 2 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.retry_delay = 0.0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.socket_keepalive_count = 1 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.socket_keepalive_idle = 1 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.socket_keepalive_interval = 1 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.socket_timeout = 1.0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.tls_allowed_ciphers = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.tls_cafile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.tls_certfile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.tls_enabled = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.tls_keyfile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cache.username = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.asyncio_connection = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.asyncio_slave_connection = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.backend = sqlalchemy {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.connection = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.connection_debug = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.connection_parameters = {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.connection_recycle_time = 3600 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.connection_trace = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.db_inc_retry_interval = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.db_max_retries = 20 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.db_max_retry_interval = 10 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.db_retry_interval = 1 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.max_overflow = 50 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.max_pool_size = 5 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.max_retries = 10 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.mysql_wsrep_sync_wait = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.pool_timeout = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.retry_interval = 10 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.slave_connection = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.sqlite_synchronous = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.synchronous_reader = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] database.use_db_reconnect = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] profiler.connection_string = messaging:// {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] profiler.enabled = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] profiler.es_doc_type = notification {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] profiler.es_scroll_size = 10000 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] profiler.es_scroll_time = 2m {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] profiler.filter_error_trace = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] profiler.hmac_keys = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] profiler.sentinel_service_name = mymaster {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] profiler.socket_timeout = 0.1 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] profiler.trace_requests = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] profiler.trace_sqlalchemy = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] profiler_jaeger.process_tags = {} {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] profiler_jaeger.service_name_prefix = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] profiler_otlp.service_name_prefix = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_policy.enforce_new_defaults = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_policy.enforce_scope = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_policy.policy_default_rule = default {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_policy.policy_file = policy.yaml {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] coordination.backend_url = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] privsep_osbrick.group = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] privsep_osbrick.helper_command = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] privsep_osbrick.user = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cinder_sys_admin.group = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cinder_sys_admin.helper_command = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] cinder_sys_admin.user = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] service_user.auth_section = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] service_user.auth_type = password {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] service_user.cafile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] service_user.certfile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] service_user.collect_timing = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] service_user.insecure = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] service_user.keyfile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] service_user.send_service_user_token = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] service_user.split_loggers = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] service_user.timeout = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance.auth_section = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance.auth_type = password {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance.certfile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance.collect_timing = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance.insecure = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance.keyfile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance.region_name = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance.split_loggers = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] glance.timeout = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.backend_availability_zone = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.chap_password = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.chap_username = {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.disk_geometry = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.driver_client_cert = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.driver_client_cert_key = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.driver_data_namespace = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.driver_use_ssl = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.extra_capabilities = {} {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.filter_function = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.goodness_function = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.iscsi_target_flags = {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.iscsi_write_cache = on {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86440]: DEBUG oslo_concurrency.processutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=86440) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.iser_helper = tgtadm {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.iser_ip_address = 192.168.122.68 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86440]: DEBUG oslo_concurrency.lockutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86440) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.iser_port = 3260 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86440]: DEBUG oslo_concurrency.lockutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86440) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86440]: DEBUG cinder.volume.drivers.quobyte [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=86440) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.nas_host = {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.nas_login = admin {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86440]: INFO cinder.volume.drivers.quobyte [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 ... Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.nas_mount_options = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.nas_password = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86440]: DEBUG oslo_concurrency.processutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea -c /etc/quobyte/client-cinder.cfg {{(pid=86440) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.nas_private_key = {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.nas_share_path = {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.num_shell_tries = 3 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.quobyte_volume_url = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.replication_device = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.report_discard_supported = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.reserved_percentage = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack sudo[86446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea -c /etc/quobyte/client-cinder.cfg Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.target_helper = tgtadm {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.target_ip_address = 192.168.122.68 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.target_port = 3260 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.target_protocol = iscsi {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack sudo[86446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.trace_flags = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.unique_fqdn_network = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.use_chap_auth = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.volume_backend_name = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.volume_clear = zero {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.volume_clear_ionice = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.volume_clear_size = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_reports.file_event_handler = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_reports.log_dir = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.backend_availability_zone = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.backend_host = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.chap_password = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.chap_username = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.chiscsi_conf = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.disk_geometry = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.driver_client_cert = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.driver_data_namespace = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.driver_use_ssl = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.extra_capabilities = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.filter_function = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.goodness_function = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.iser_helper = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.iser_ip_address = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.iser_port = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.iser_target_prefix = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.nas_host = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.nas_login = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.nas_mount_options = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.nas_password = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.nas_private_key = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.nas_share_path = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.nas_ssh_port = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.num_shell_tries = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.nvmet_port_id = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.replication_device = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.report_discard_supported = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.reserved_percentage = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.scst_target_driver = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.storage_protocol = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.target_helper = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.target_ip_address = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.target_port = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.target_prefix = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.target_protocol = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.trace_flags = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.use_chap_auth = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.volume_clear = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.volume_clear_size = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] QuobyteHD.volumes_dir = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.ssl = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_notifications.driver = [] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_notifications.retry = -1 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] key_manager.fixed_key = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican.barbican_api_version = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican.barbican_endpoint = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican.barbican_endpoint_type = public {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican.barbican_region_name = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican.cafile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican.certfile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican.collect_timing = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican.insecure = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican.keyfile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican.number_of_retries = 60 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican.retry_delay = 1 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican.send_service_user_token = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican.split_loggers = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican.timeout = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican.verify_ssl = True {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican.verify_ssl_path = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican_service_user.auth_section = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican_service_user.auth_type = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican_service_user.cafile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican_service_user.certfile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican_service_user.collect_timing = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican_service_user.insecure = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican_service_user.keyfile = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican_service_user.split_loggers = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] barbican_service_user.timeout = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] vault.approle_role_id = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] vault.approle_secret_id = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] vault.kv_mountpoint = secret {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] vault.kv_path = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] vault.kv_version = 2 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] vault.namespace = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] vault.root_token_id = **** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] vault.ssl_ca_crt_file = None {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] vault.timeout = 60.0 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] vault.use_ssl = False {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:27 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] ******************************************************************************** {{(pid=86224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 14:06:28 devstack sudo[86446]: pam_unix(sudo:session): session closed for user root Jul 09 14:06:28 devstack cinder-volume[86440]: DEBUG oslo_concurrency.processutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.709s {{(pid=86440) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:06:28 devstack cinder-volume[86440]: INFO cinder.volume.drivers.quobyte [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 succeeded Jul 09 14:06:28 devstack cinder-volume[86440]: DEBUG cinder.volume.drivers.quobyte [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=86440) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:06:28 devstack cinder-volume[86440]: DEBUG oslo_concurrency.lockutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.718s {{(pid=86440) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:06:28 devstack cinder-volume[86440]: DEBUG oslo_concurrency.processutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=86440) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:06:28 devstack sudo[86515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:06:28 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:06:29 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root Jul 09 14:06:29 devstack cinder-volume[86440]: DEBUG oslo_concurrency.processutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.583s {{(pid=86440) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:06:29 devstack cinder-volume[86440]: INFO cinder.volume.driver [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Driver hasn't implemented _init_vendor_properties() Jul 09 14:06:29 devstack cinder-volume[86440]: DEBUG cinder.volume.driver [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7545547485352, 'free_capacity_gb': 1775.7545547485352, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86440) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 14:06:29 devstack cinder-volume[86440]: DEBUG oslo_db.sqlalchemy.engines [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86440) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 14:06:29 devstack cinder-volume[86440]: DEBUG dbcounter [-] [86440] Writer thread running {{(pid=86440) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 14:06:29 devstack cinder-volume[86440]: DEBUG cinder.db.sqlalchemy.api [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Building query based on filter {{(pid=86440) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jul 09 14:06:29 devstack cinder-volume[86440]: DEBUG cinder.image.image_utils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86440) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 14:06:29 devstack cinder-volume[86440]: INFO cinder.keymgr.migration [None req-71e75091-16dc-4a20-a70e-a6d617fc55e7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 14:06:29 devstack cinder-volume[86440]: DEBUG oslo_concurrency.lockutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86440) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:06:29 devstack cinder-volume[86440]: DEBUG oslo_concurrency.lockutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86440) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:06:29 devstack cinder-volume[86440]: DEBUG cinder.volume.drivers.quobyte [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=86440) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:06:29 devstack cinder-volume[86440]: DEBUG cinder.volume.drivers.quobyte [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=86440) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:06:29 devstack cinder-volume[86440]: DEBUG oslo_concurrency.lockutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86440) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:06:29 devstack cinder-volume[86440]: DEBUG oslo_concurrency.processutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=86440) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:06:29 devstack sudo[86518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:06:29 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:06:29 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root Jul 09 14:06:29 devstack cinder-volume[86440]: DEBUG oslo_concurrency.processutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.617s {{(pid=86440) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:06:29 devstack cinder-volume[86440]: DEBUG cinder.manager [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Notifying Schedulers of capabilities ... {{(pid=86440) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:06:29 devstack cinder-volume[86440]: INFO cinder.volume.manager [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Driver initialization completed successfully. Jul 09 14:06:29 devstack cinder-volume[86440]: INFO cinder.manager [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Initiating service 3 cleanup Jul 09 14:06:29 devstack cinder-volume[86440]: INFO cinder.manager [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Service 3 cleanup completed. Jul 09 14:06:29 devstack cinder-volume[86440]: DEBUG cinder.service [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Creating RPC server for service cinder-volume {{(pid=86440) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 14:06:29 devstack cinder-volume[86440]: DEBUG cinder.service [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86440) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 14:06:30 devstack cinder-volume[86440]: INFO cinder.volume.manager [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 14:06:30 devstack cinder-volume[86440]: DEBUG oslo_concurrency.lockutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86440) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:06:30 devstack cinder-volume[86440]: DEBUG oslo_concurrency.lockutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86440) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:06:30 devstack cinder-volume[86440]: DEBUG cinder.volume.drivers.quobyte [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=86440) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:06:30 devstack cinder-volume[86440]: DEBUG cinder.volume.drivers.quobyte [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=86440) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:06:30 devstack cinder-volume[86440]: DEBUG oslo_concurrency.lockutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86440) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:06:30 devstack cinder-volume[86440]: DEBUG oslo_concurrency.processutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=86440) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:06:30 devstack sudo[86525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:06:30 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:06:30 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root Jul 09 14:06:30 devstack cinder-volume[86440]: DEBUG oslo_concurrency.processutils [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.828s {{(pid=86440) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:06:30 devstack cinder-volume[86440]: INFO cinder.volume.manager [None req-0e937063-597d-47b1-a5a2-8b9a1b3bfacc None None] Driver post RPC initialization completed successfully. Jul 09 14:06:34 devstack cinder-volume[86440]: DEBUG oslo_concurrency.lockutils [None req-821b9402-fb22-44b0-9fef-de7daf8c67d9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86440) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:06:34 devstack cinder-volume[86440]: DEBUG oslo_concurrency.lockutils [None req-821b9402-fb22-44b0-9fef-de7daf8c67d9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86440) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:06:34 devstack cinder-volume[86440]: DEBUG cinder.volume.drivers.quobyte [None req-821b9402-fb22-44b0-9fef-de7daf8c67d9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=86440) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:06:34 devstack cinder-volume[86440]: DEBUG cinder.volume.drivers.quobyte [None req-821b9402-fb22-44b0-9fef-de7daf8c67d9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=86440) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:06:34 devstack cinder-volume[86440]: DEBUG oslo_concurrency.lockutils [None req-821b9402-fb22-44b0-9fef-de7daf8c67d9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86440) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:06:34 devstack cinder-volume[86440]: DEBUG oslo_concurrency.processutils [None req-821b9402-fb22-44b0-9fef-de7daf8c67d9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=86440) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:06:34 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:06:34 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:06:35 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Jul 09 14:06:35 devstack cinder-volume[86440]: DEBUG oslo_concurrency.processutils [None req-821b9402-fb22-44b0-9fef-de7daf8c67d9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.579s {{(pid=86440) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:06:35 devstack cinder-volume[86440]: DEBUG cinder.manager [None req-821b9402-fb22-44b0-9fef-de7daf8c67d9 None None] Notifying Schedulers of capabilities ... {{(pid=86440) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:06:37 devstack cinder-volume[86224]: INFO oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Caught SIGTERM, stopping children Jul 09 14:06:37 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Acquiring lock "singleton_lock" {{(pid=86224) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 14:06:37 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Acquired lock "singleton_lock" {{(pid=86224) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 14:06:37 devstack cinder-volume[86224]: DEBUG oslo_concurrency.lockutils [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Releasing lock "singleton_lock" {{(pid=86224) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 14:06:37 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Stop services. {{(pid=86224) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 14:06:37 devstack cinder-volume[86224]: DEBUG oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Killing children. {{(pid=86224) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 14:06:37 devstack cinder-volume[86224]: INFO oslo_service.backend._eventlet.service [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Waiting on 1 children to exit Jul 09 14:06:40 devstack cinder-volume[86440]: DEBUG dbcounter [-] [86440] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86440) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:06:41 devstack cinder-volume[86440]: DEBUG dbcounter [-] [86440] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86440) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:06:42 devstack cinder-volume[86440]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 09 14:06:42 devstack cinder-volume[86736]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 14:06:42 devstack cinder-volume[86736]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 14:06:42 devstack cinder-volume[86736]: we strongly recommend against using it for new projects. Jul 09 14:06:42 devstack cinder-volume[86736]: If you are already using Eventlet, we recommend migrating to a different Jul 09 14:06:42 devstack cinder-volume[86736]: framework. For more detail see Jul 09 14:06:42 devstack cinder-volume[86736]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 14:06:42 devstack cinder-volume[86736]: import eventlet # noqa Jul 09 14:06:43 devstack cinder-volume[86440]: DEBUG oslo_concurrency.lockutils [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Acquiring lock "singleton_lock" {{(pid=86440) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 14:06:43 devstack cinder-volume[86440]: DEBUG oslo_concurrency.lockutils [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Acquired lock "singleton_lock" {{(pid=86440) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 14:06:43 devstack cinder-volume[86440]: DEBUG oslo_concurrency.lockutils [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Releasing lock "singleton_lock" {{(pid=86440) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 14:06:43 devstack cinder-volume[86440]: WARNING amqp [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 14:06:43 devstack cinder-volume[86440]: WARNING amqp [None req-56b17c13-afe9-4f2a-bd0c-17491342bc91 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 14:06:44 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86736) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 14:06:44 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86736) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 14:06:44 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86736) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 14:06:45 devstack cinder-volume[86736]: INFO dbcounter [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] Registered counter for database cinder Jul 09 14:06:45 devstack cinder-volume[86736]: DEBUG oslo_db.sqlalchemy.engines [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86736) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 14:06:45 devstack cinder-volume[86736]: DEBUG dbcounter [-] [86736] Writer thread running {{(pid=86736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 14:06:45 devstack cinder-volume[86736]: INFO cinder.rpc [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 14:06:45 devstack cinder-volume[86736]: INFO cinder.rpc [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_db.sqlalchemy.engines [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86736) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 14:06:46 devstack cinder-volume[86736]: INFO cinder.volume.manager [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] Determined volume DB was empty at startup. Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG cinder.volume.manager [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86736) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 14:06:46 devstack cinder-volume[86736]: WARNING stevedore.named [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 14:06:46 devstack cinder-volume[86736]: WARNING castellan.key_manager [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 14:06:46 devstack cinder-volume[86736]: WARNING cinder.keymgr.conf_key_mgr [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 14:06:46 devstack cinder-volume[86736]: INFO cinder.volume.manager [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_db.sqlalchemy.engines [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86736) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 14:06:46 devstack cinder-volume[86736]: INFO oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] Starting 1 workers Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] Started child 87011 {{(pid=86736) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] Full set of CONF: {{(pid=86736) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] ******************************************************************************** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] Configuration options gathered from: {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] ================================================================================ {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] allow_availability_zone_fallback = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] allow_compression_on_image_upload = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] allowed_direct_url_schemes = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] api_rate_limit = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[87011]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] auth_strategy = keystone {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_availability_zone = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_host = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_stats_polling_interval = 60 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backup_api_class = cinder.backup.api.API {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backup_name_template = backup-%s {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backup_use_same_host = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backup_use_temp_snapshot = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] chap_password = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] chap_username = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cinder_internal_tenant_project_id = dcc7d81023d64598a80fce6db0251109 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cinder_internal_tenant_user_id = bb04c2fcb65b458e85371c351d67b325 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cluster = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] compression_format = gzip {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] compute_api_class = cinder.compute.nova.API {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] config_dir = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] config_source = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] control_exchange = openstack {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] debug = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] default_availability_zone = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] default_group_type = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] default_volume_type = QuobyteHD {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] disk_geometry = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] driver_client_cert = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] driver_client_cert_key = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] driver_data_namespace = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] driver_ssl_cert_path = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] driver_ssl_cert_verify = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] driver_use_ssl = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] enable_new_services = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] enable_unsupported_driver = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] enabled_backends = ['QuobyteHD'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] enforce_multipath_for_image_xfer = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] filter_function = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance_api_insecure = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance_api_servers = ['http://192.168.122.68/image'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance_api_ssl_compression = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance_ca_certificates_file = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance_catalog_info = image:glance:publicURL {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance_certfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance_keyfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance_num_retries = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance_request_timeout = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] goodness_function = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] graceful_shutdown_timeout = 5 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] group_api_class = cinder.group.api.API {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] host = devstack {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] image_compress_on_upload = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] image_conversion_address_space_limit = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] image_conversion_cpu_limit = 60 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] image_conversion_disable = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] image_upload_use_cinder_backend = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] image_upload_use_internal_tenant = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] image_volume_cache_enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] image_volume_cache_max_count = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] image_volume_cache_max_size_gb = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] init_host_max_objects_retrieval = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] instance_format = [instance: %(uuid)s] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] iscsi_target_flags = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] iscsi_write_cache = on {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] iser_helper = tgtadm {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] iser_ip_address = 192.168.122.68 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] iser_port = 3260 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] log_color = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] log_config_append = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] log_dir = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] log_file = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] log_options = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] log_rotate_interval = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] log_rotate_interval_type = days {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] log_rotation_type = none {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] max_age = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] max_logfile_count = 30 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] max_logfile_size_mb = 200 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] max_over_subscription_ratio = 20.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] message_reap_interval = 86400 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] message_ttl = 2592000 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] migration_create_volume_timeout_secs = 300 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] monkey_patch = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] monkey_patch_modules = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] my_ip = 192.168.122.68 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] no_snapshot_gb_quota = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] num_iser_scan_tries = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] num_shell_tries = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] num_volume_device_scan_tries = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] nvmeof_conn_info_version = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] nvmet_ns_id = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] nvmet_port_id = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] osapi_max_limit = 1000 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] osapi_volume_ext_list = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87011) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] osapi_volume_listen_port = 8776 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] osapi_volume_use_ssl = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] osapi_volume_workers = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] per_volume_size_limit = -1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] periodic_fuzzy_delay = 60 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] periodic_interval = 60 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] public_endpoint = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] publish_errors = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] quota_backup_gigabytes = 1000 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] quota_backups = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] quota_gigabytes = 1000 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] quota_groups = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] quota_snapshots = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] quota_volumes = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] rate_limit_burst = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] rate_limit_except_level = CRITICAL {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] rate_limit_interval = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] reinit_driver_count = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] replication_device = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] report_discard_supported = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] report_interval = 120 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] reservation_clean_interval = 86400 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] reservation_expire = 86400 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] reserved_image_namespaces = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] reserved_percentage = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] rpc_response_timeout = 120 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] run_external_periodic_tasks = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] scst_target_driver = iscsi {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] scst_target_iqn_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] service_down_time = 720 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] shell_completion = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] snapshot_name_template = snapshot-%s {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] split_loggers = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] state_path = /opt/stack/data/cinder {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] storage_availability_zone = nova {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] storage_protocol = iSCSI {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] syslog_log_facility = LOG_USER {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] target_helper = lioadm {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] target_ip_address = 192.168.122.68 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] target_port = 3260 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] target_protocol = iscsi {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] target_secondary_ip_addresses = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] trace_flags = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] transport_url = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] until_refresh = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] use_chap_auth = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] use_default_quota_class = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] use_journal = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] use_json = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] use_multipath_for_image_xfer = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] use_stderr = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] use_syslog = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] verify_glance_signatures = enabled {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] volume_api_class = cinder.volume.api.API {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] volume_backend_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] volume_clear = zero {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] volume_clear_ionice = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] volume_clear_size = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] volume_copy_bps_limit = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] volume_dd_blocksize = 1M {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] volume_name_template = volume-%s {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] volume_service_inithost_offload = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] volume_usage_audit_period = month {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] zoning_mode = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_concurrency.disable_process_locking = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.auth_section = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.auth_type = password {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.auth_version = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.cache = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.certfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.include_service_catalog = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.insecure = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.interface = public {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.keyfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.memcache_password = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.memcache_username = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.region_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.service_type = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.68/identity {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.backend = dogpile.cache.null {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.backend_argument = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.backend_expiration_time = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.config_prefix = cache.oslo {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.debug_cache_backend = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.enable_retry_client = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.enable_socket_keepalive = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.expiration_time = 600 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.hashclient_retry_attempts = 2 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.memcache_dead_retry = 300 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.memcache_pool_maxsize = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.memcache_sasl_enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.password = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.proxies = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.redis_db = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.redis_server = localhost:6379 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.retry_attempts = 2 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.retry_delay = 0.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.socket_keepalive_count = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.socket_keepalive_idle = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.socket_keepalive_interval = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.socket_timeout = 1.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.tls_allowed_ciphers = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.tls_cafile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.tls_certfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.tls_enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.tls_keyfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cache.username = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.asyncio_connection = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.asyncio_slave_connection = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.backend = sqlalchemy {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.connection = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.connection_debug = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.connection_parameters = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.connection_recycle_time = 3600 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.connection_trace = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.db_inc_retry_interval = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.db_max_retries = 20 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.db_max_retry_interval = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.db_retry_interval = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.max_overflow = 50 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.max_pool_size = 5 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.max_retries = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.mysql_wsrep_sync_wait = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.pool_timeout = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.retry_interval = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.slave_connection = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.sqlite_synchronous = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.synchronous_reader = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] database.use_db_reconnect = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] profiler.connection_string = messaging:// {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] profiler.enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] profiler.es_doc_type = notification {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] profiler.es_scroll_size = 10000 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] profiler.es_scroll_time = 2m {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] profiler.filter_error_trace = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] profiler.hmac_keys = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] profiler.sentinel_service_name = mymaster {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] profiler.socket_timeout = 0.1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] profiler.trace_requests = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] profiler.trace_sqlalchemy = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87011) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] profiler_jaeger.process_tags = {} {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.quobyte [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] profiler_jaeger.service_name_prefix = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.quobyte [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] profiler_otlp.service_name_prefix = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_policy.enforce_new_defaults = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_policy.enforce_scope = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_policy.policy_default_rule = default {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Running cmd (subprocess): mount.quobyte {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_policy.policy_file = policy.yaml {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] coordination.backend_url = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] privsep_osbrick.group = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] privsep_osbrick.helper_command = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] privsep_osbrick.user = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cinder_sys_admin.group = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cinder_sys_admin.helper_command = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] cinder_sys_admin.user = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] service_user.auth_section = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] service_user.auth_type = password {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] service_user.cafile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] service_user.certfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] service_user.collect_timing = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] service_user.insecure = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] service_user.keyfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] service_user.send_service_user_token = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] service_user.split_loggers = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] service_user.timeout = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance.auth_section = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance.auth_type = password {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance.certfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance.collect_timing = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance.insecure = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance.keyfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance.region_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance.split_loggers = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] glance.timeout = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.backend_availability_zone = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.chap_password = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.chap_username = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.disk_geometry = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.driver_client_cert = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.driver_client_cert_key = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.driver_data_namespace = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.driver_use_ssl = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.extra_capabilities = {} {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.filter_function = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.goodness_function = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.iscsi_target_flags = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.iscsi_write_cache = on {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.iser_helper = tgtadm {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.iser_ip_address = 192.168.122.68 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.iser_port = 3260 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.nas_host = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.nas_login = admin {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.nas_mount_options = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.nas_password = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.nas_private_key = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.nas_share_path = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.num_shell_tries = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.quobyte_volume_url = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.replication_device = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.report_discard_supported = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.reserved_percentage = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.target_helper = tgtadm {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.target_ip_address = 192.168.122.68 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.target_port = 3260 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.target_protocol = iscsi {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.trace_flags = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.unique_fqdn_network = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.use_chap_auth = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.volume_backend_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.volume_clear = zero {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.volume_clear_ionice = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.volume_clear_size = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_reports.file_event_handler = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_reports.log_dir = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.backend_availability_zone = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.backend_host = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.chap_password = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.chap_username = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.chiscsi_conf = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.disk_geometry = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.driver_client_cert = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.driver_data_namespace = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack quobyte-client[87023]: Reading configuration file: /etc/quobyte/client.cfg Jul 09 14:06:46 devstack quobyte-client[87023]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.driver_use_ssl = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.extra_capabilities = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.filter_function = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.goodness_function = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.iser_helper = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.iser_ip_address = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.iser_port = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.iser_target_prefix = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.nas_host = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.nas_login = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.nas_mount_options = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.nas_password = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.nas_private_key = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.nas_share_path = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.nas_ssh_port = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.num_shell_tries = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.nvmet_port_id = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.replication_device = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.report_discard_supported = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.reserved_percentage = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.scst_target_driver = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.storage_protocol = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.target_helper = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.target_ip_address = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.target_port = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.target_prefix = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.target_protocol = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.trace_flags = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.use_chap_auth = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.volume_clear = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.volume_clear_size = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] QuobyteHD.volumes_dir = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.ssl = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_notifications.driver = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_notifications.retry = -1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] key_manager.fixed_key = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican.barbican_api_version = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican.barbican_endpoint = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican.barbican_endpoint_type = public {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican.barbican_region_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican.cafile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican.certfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican.collect_timing = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican.insecure = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican.keyfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican.number_of_retries = 60 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican.retry_delay = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican.send_service_user_token = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican.split_loggers = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican.timeout = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican.verify_ssl = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican.verify_ssl_path = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican_service_user.auth_section = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican_service_user.auth_type = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican_service_user.cafile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican_service_user.certfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican_service_user.collect_timing = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican_service_user.insecure = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican_service_user.keyfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican_service_user.split_loggers = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] barbican_service_user.timeout = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] vault.approle_role_id = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] vault.approle_secret_id = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack sudo[87030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] vault.kv_mountpoint = secret {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] vault.kv_path = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] vault.kv_version = 2 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] vault.namespace = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] vault.root_token_id = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] vault.ssl_ca_crt_file = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] vault.timeout = 60.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] vault.use_ssl = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 14:06:46 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-397cb757-299f-426c-a421-2e8eeb6c5a41 None None] ******************************************************************************** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 14:06:46 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root Jul 09 14:06:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.610s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:06:46 devstack cinder-volume[87011]: INFO cinder.volume.driver [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Driver hasn't implemented _init_vendor_properties() Jul 09 14:06:46 devstack cinder-volume[87011]: DEBUG cinder.volume.driver [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7545547485352, 'free_capacity_gb': 1775.7545547485352, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87011) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG oslo_db.sqlalchemy.engines [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87011) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writer thread running {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG cinder.db.sqlalchemy.api [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Building query based on filter {{(pid=87011) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87011) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:06:47 devstack cinder-volume[87011]: INFO cinder.keymgr.migration [None req-0397cdc8-7e16-416a-9416-53180ae452e3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 14:06:47 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:06:47 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:06:47 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.594s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:06:47 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Driver initialization completed successfully. Jul 09 14:06:47 devstack cinder-volume[87011]: INFO cinder.manager [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Initiating service 3 cleanup Jul 09 14:06:47 devstack cinder-volume[87011]: INFO cinder.manager [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Service 3 cleanup completed. Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG cinder.service [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Creating RPC server for service cinder-volume {{(pid=87011) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG cinder.service [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87011) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 14:06:47 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:06:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:06:47 devstack sudo[87077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:06:47 devstack sudo[87077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:06:48 devstack sudo[87077]: pam_unix(sudo:session): session closed for user root Jul 09 14:06:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.620s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:06:48 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-4740ed3d-0f0d-44ef-8598-30eb0034e18b None None] Driver post RPC initialization completed successfully. Jul 09 14:06:56 devstack cinder-volume[86736]: DEBUG dbcounter [-] [86736] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:06:57 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=2 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:06:58 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:07:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:07:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 6 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:07:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:07:59 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:07:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Flow 'volume_create_manager' (5eb273a3-d04d-49ee-a1c9-ac0c454e7ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:07:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (604cb659-7714-4439-8306-dd9771128f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:07:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (604cb659-7714-4439-8306-dd9771128f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1841522908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1291013d-f84c-4fb6-b9b5-e9f9f6169f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b133b64b0a4587bf1883a73d6b9b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:07:59Z,use_quota=True,user_id='7a3ad2e64f09430493b383063e4cf70b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:07:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (755062fc-29a8-4d55-8511-b7237b0f9edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:07:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (755062fc-29a8-4d55-8511-b7237b0f9edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:07:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b157a4-97b8-413a-a2e9-0a298f8d32f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:07:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b157a4-97b8-413a-a2e9-0a298f8d32f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1291013d-f84c-4fb6-b9b5-e9f9f6169f7e', 'volume_name': 'volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:07:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66e0678-2702-4e7d-9697-2557b25e5f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:07:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66e0678-2702-4e7d-9697-2557b25e5f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:08:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dab6a1c-74ad-4fa9-83be-85da1aff2945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:08:00 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Volume 1291013d-f84c-4fb6-b9b5-e9f9f6169f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e', 'volume_size': 1} Jul 09 14:08:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:08:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:08:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1841522908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1291013d-f84c-4fb6-b9b5-e9f9f6169f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b133b64b0a4587bf1883a73d6b9b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:07:59Z,use_quota=True,user_id='7a3ad2e64f09430493b383063e4cf70b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:08:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Creating volume 1291013d-f84c-4fb6-b9b5-e9f9f6169f7e {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:08:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:08:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:08:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:08:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:08:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:08:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:08:00 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:08:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:08:00 devstack sudo[87845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e 1073741824 Jul 09 14:08:00 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:08:02 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root Jul 09 14:08:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e 1073741824" returned: 0 in 2.271s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:08:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:08:02 devstack sudo[88181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e Jul 09 14:08:02 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:08:03 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root Jul 09 14:08:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e" returned: 0 in 1.158s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:08:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] <== create_volume: return (3550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:08:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.557s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:08:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dab6a1c-74ad-4fa9-83be-85da1aff2945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:08:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d9b490f-d8ab-482e-8b0e-bf56e2fa3679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:08:03 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Volume volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e (1291013d-f84c-4fb6-b9b5-e9f9f6169f7e): created successfully Jul 09 14:08:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d9b490f-d8ab-482e-8b0e-bf56e2fa3679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:08:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Flow 'volume_create_manager' (5eb273a3-d04d-49ee-a1c9-ac0c454e7ecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:08:03 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9140695d-f67f-4b2b-867b-cdfe63bcb787 tempest-DeleteServersTestJSON-199619038 None] Created volume successfully. Jul 09 14:08:11 devstack cinder-volume[87011]: WARNING py.warnings [req-b3b5fe33-67ac-4652-a7d5-e8a9cf02815e req-e3d35f4f-900e-4f65-8892-46f59d717c73 tempest-DeleteServersTestJSON-199619038 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2505: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jul 09 14:08:11 devstack cinder-volume[87011]: .first() Jul 09 14:08:11 devstack cinder-volume[87011]: Jul 09 14:08:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-b3b5fe33-67ac-4652-a7d5-e8a9cf02815e req-e3d35f4f-900e-4f65-8892-46f59d717c73 tempest-DeleteServersTestJSON-199619038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:08:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-b3b5fe33-67ac-4652-a7d5-e8a9cf02815e req-e3d35f4f-900e-4f65-8892-46f59d717c73 tempest-DeleteServersTestJSON-199619038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:08:11 devstack cinder-volume[87011]: INFO oslo.privsep.daemon [req-b3b5fe33-67ac-4652-a7d5-e8a9cf02815e req-e3d35f4f-900e-4f65-8892-46f59d717c73 tempest-DeleteServersTestJSON-199619038 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpv6bnqgle/privsep.sock'] Jul 09 14:08:11 devstack sudo[88264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpv6bnqgle/privsep.sock Jul 09 14:08:11 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:08:11 devstack cinder-volume[87011]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 09 14:08:11 devstack cinder-volume[87011]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 14:08:11 devstack cinder-volume[87011]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 14:08:11 devstack cinder-volume[87011]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 14:08:11 devstack cinder-volume[87011]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 14:08:11 devstack cinder-volume[87011]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 14:08:11 devstack cinder-volume[87011]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 14:08:11 devstack cinder-volume[87011]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 14:08:11 devstack cinder-volume[87011]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 09 14:08:12 devstack cinder-volume[87011]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 09 14:08:12 devstack cinder-volume[87011]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 14:08:12 devstack cinder-volume[87011]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 14:08:12 devstack cinder-volume[87011]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 14:08:12 devstack cinder-volume[87011]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 14:08:12 devstack cinder-volume[87011]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 14:08:12 devstack cinder-volume[87011]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 14:08:12 devstack cinder-volume[87011]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 14:08:12 devstack cinder-volume[87011]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 09 14:08:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:08:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:08:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:08:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:08:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:08:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:08:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:08:12 devstack sudo[88267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:08:12 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:08:12 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root Jul 09 14:08:12 devstack cinder-volume[87011]: INFO oslo.privsep.daemon [req-b3b5fe33-67ac-4652-a7d5-e8a9cf02815e req-e3d35f4f-900e-4f65-8892-46f59d717c73 tempest-DeleteServersTestJSON-199619038 None] Spawned new privsep daemon via rootwrap Jul 09 14:08:12 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [req-b3b5fe33-67ac-4652-a7d5-e8a9cf02815e req-e3d35f4f-900e-4f65-8892-46f59d717c73 tempest-DeleteServersTestJSON-199619038 None] Accepted privsep connection to /tmp/tmpv6bnqgle/privsep.sock {{(pid=87011) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 09 14:08:12 devstack cinder-volume[87011]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 09 14:08:12 devstack cinder-volume[87011]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 09 14:08:12 devstack cinder-volume[87011]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 09 14:08:12 devstack cinder-volume[87011]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88269 Jul 09 14:08:12 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf29a477-4930-43e4-a477-c36624791300]: (2,) {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:08:12 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[e866dce5-7a9c-40b3-ba4a-e989cb437d02]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:08:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-b3b5fe33-67ac-4652-a7d5-e8a9cf02815e req-e3d35f4f-900e-4f65-8892-46f59d717c73 tempest-DeleteServersTestJSON-199619038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:08:13 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e Jul 09 14:08:13 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:08:13 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root Jul 09 14:08:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.920s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:08:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:08:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:08:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 8 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:08:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:08:13 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Jul 09 14:08:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-b3b5fe33-67ac-4652-a7d5-e8a9cf02815e req-e3d35f4f-900e-4f65-8892-46f59d717c73 tempest-DeleteServersTestJSON-199619038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e" returned: 0 in 0.969s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:08:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-b3b5fe33-67ac-4652-a7d5-e8a9cf02815e req-e3d35f4f-900e-4f65-8892-46f59d717c73 tempest-DeleteServersTestJSON-199619038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.609s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:08:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-b3b5fe33-67ac-4652-a7d5-e8a9cf02815e req-e3d35f4f-900e-4f65-8892-46f59d717c73 tempest-DeleteServersTestJSON-199619038 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c7c47d4-9fe3-4b8b-bf92-4c0795cb692d', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:08:14 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-b3b5fe33-67ac-4652-a7d5-e8a9cf02815e req-e3d35f4f-900e-4f65-8892-46f59d717c73 tempest-DeleteServersTestJSON-199619038 None] attachment_update completed successfully. Jul 09 14:08:24 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-01f5ea6d-71d4-468a-afb9-0e114a4b8227 req-f8f5182d-f6de-4a3f-8b94-ec801c3681a6 tempest-DeleteServersTestJSON-199619038 None] Terminate volume connection completed successfully. Jul 09 14:08:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-01f5ea6d-71d4-468a-afb9-0e114a4b8227 req-f8f5182d-f6de-4a3f-8b94-ec801c3681a6 tempest-DeleteServersTestJSON-199619038 None] Deleting attachment 8c7c47d4-9fe3-4b8b-bf92-4c0795cb692d. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Flow 'volume_create_manager' (783cdcf0-e618-474c-825b-fd6adf1d93fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6517065b-1391-47c5-b40a-591c5d2a05b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6517065b-1391-47c5-b40a-591c5d2a05b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-171694805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e738c6ce-2c4d-4e7c-a3a5-83263e33389b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9986ea392cb94b35b696c956d33f27f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:08:25Z,use_quota=True,user_id='738381f58f9647b2b55e7283075b7bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce452904-903e-4959-bba9-b076c2b1d726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce452904-903e-4959-bba9-b076c2b1d726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b954f1e-7edc-41cc-8c6b-cb06216d7895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b954f1e-7edc-41cc-8c6b-cb06216d7895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e738c6ce-2c4d-4e7c-a3a5-83263e33389b', 'volume_name': 'volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e901a9fe-7203-430d-9ab2-8a0cf3512777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e901a9fe-7203-430d-9ab2-8a0cf3512777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d2d492-b649-44fe-b52e-1d753d478a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:08:25 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Volume e738c6ce-2c4d-4e7c-a3a5-83263e33389b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b', 'volume_size': 1} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-171694805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e738c6ce-2c4d-4e7c-a3a5-83263e33389b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9986ea392cb94b35b696c956d33f27f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:08:25Z,use_quota=True,user_id='738381f58f9647b2b55e7283075b7bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Creating volume e738c6ce-2c4d-4e7c-a3a5-83263e33389b {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:08:25 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:08:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:08:25 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b 1073741824 Jul 09 14:08:25 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:08:26 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Jul 09 14:08:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b 1073741824" returned: 0 in 0.908s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:08:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:08:26 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b Jul 09 14:08:26 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:08:26 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Jul 09 14:08:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b" returned: 0 in 0.613s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:08:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:08:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:08:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d2d492-b649-44fe-b52e-1d753d478a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:08:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7408d803-ea61-43af-a4db-759503094fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:08:26 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Volume volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b (e738c6ce-2c4d-4e7c-a3a5-83263e33389b): created successfully Jul 09 14:08:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7408d803-ea61-43af-a4db-759503094fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:08:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Flow 'volume_create_manager' (783cdcf0-e618-474c-825b-fd6adf1d93fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:08:26 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-6d685490-cb13-4834-bd47-f2d8e794a2de tempest-AttachVolumeNegativeTest-335382434 None] Created volume successfully. Jul 09 14:08:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Acquiring lock "cinder-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:08:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Lock "cinder-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:08:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Acquiring lock "cinder-quobyte-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:08:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Lock "cinder-quobyte-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:08:28 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceb7ecc-7ce7-4d93-a97b-4a0b1cb07cc1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:08:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:08:28 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e Jul 09 14:08:28 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:08:28 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Jul 09 14:08:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e" returned: 0 in 0.794s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:08:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:08:28 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e Jul 09 14:08:28 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:08:29 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Jul 09 14:08:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e" returned: 0 in 0.677s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:08:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Lock "cinder-quobyte-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e" released by "delete_volume" :: held 1.525s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:08:29 devstack cinder-volume[87011]: WARNING cinder.quota [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:08:29 devstack cinder-volume[87011]: WARNING cinder.quota [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:08:29 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Created reservations ['c8ac122d-8566-4635-bf9d-13640a3dff1f', 'f870ad2e-4ba8-4e65-8cf6-3bc60787b16c', '9ccfcd1a-a61e-4bc0-8d6c-8d91fbd53edc', 'c2ab3220-1ed5-464c-89be-3c54626676de'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:08:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:08:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:08:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:08:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:08:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:08:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:08:29 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:08:29 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:08:30 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Jul 09 14:08:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.793s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:08:30 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:08:30 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Deleted volume successfully. Jul 09 14:08:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-17c342fc-1c1a-476d-a883-e7ce90ee59e4 tempest-DeleteServersTestJSON-199619038 None] Lock "cinder-1291013d-f84c-4fb6-b9b5-e9f9f6169f7e-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:08:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-8358ad79-d83f-474a-adf1-bb0c554fefe6 req-d61b021f-9e30-428f-b7b2-f5f3e358ecf2 tempest-AttachVolumeNegativeTest-335382434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:08:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-8358ad79-d83f-474a-adf1-bb0c554fefe6 req-d61b021f-9e30-428f-b7b2-f5f3e358ecf2 tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:08:30 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[4688c0c2-aae3-4b51-8fc7-41c6886f61dd]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:08:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-8358ad79-d83f-474a-adf1-bb0c554fefe6 req-d61b021f-9e30-428f-b7b2-f5f3e358ecf2 tempest-AttachVolumeNegativeTest-335382434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:08:31 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b Jul 09 14:08:31 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Flow 'volume_create_manager' (6c118a31-8a4e-49b8-b26b-21eca242d921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7c2c75-5ccf-4493-8c69-7f799183944e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d7c2c75-5ccf-4493-8c69-7f799183944e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-789002415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4085ca-4460-4059-9d0f-d884a84034d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ffec16193740ea8d23ef9af79dbc01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:08:32Z,use_quota=True,user_id='5048aae1df41460d927de006a81f93f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3caa6b-0c61-44a8-8904-3abf2d1ab3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3caa6b-0c61-44a8-8904-3abf2d1ab3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a767b0-53a1-4aa2-a171-fcc36a1f3c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a767b0-53a1-4aa2-a171-fcc36a1f3c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f4085ca-4460-4059-9d0f-d884a84034d7', 'volume_name': 'volume-8f4085ca-4460-4059-9d0f-d884a84034d7', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75faa3fc-3f7f-4f9c-9def-b4e4e9fae233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75faa3fc-3f7f-4f9c-9def-b4e4e9fae233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9907d190-7ad2-41d2-944e-b9d725110846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:08:31 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Volume 8f4085ca-4460-4059-9d0f-d884a84034d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f4085ca-4460-4059-9d0f-d884a84034d7', 'volume_size': 1} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:08:31 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-8358ad79-d83f-474a-adf1-bb0c554fefe6 req-d61b021f-9e30-428f-b7b2-f5f3e358ecf2 tempest-AttachVolumeNegativeTest-335382434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b" returned: 0 in 0.904s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-8358ad79-d83f-474a-adf1-bb0c554fefe6 req-d61b021f-9e30-428f-b7b2-f5f3e358ecf2 tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.929s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.060s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-789002415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4085ca-4460-4059-9d0f-d884a84034d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ffec16193740ea8d23ef9af79dbc01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:08:32Z,use_quota=True,user_id='5048aae1df41460d927de006a81f93f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Creating volume 8f4085ca-4460-4059-9d0f-d884a84034d7 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:08:31 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8f4085ca-4460-4059-9d0f-d884a84034d7 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:08:31 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8f4085ca-4460-4059-9d0f-d884a84034d7 1073741824 Jul 09 14:08:31 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:08:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-8358ad79-d83f-474a-adf1-bb0c554fefe6 req-d61b021f-9e30-428f-b7b2-f5f3e358ecf2 tempest-AttachVolumeNegativeTest-335382434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d2b30d9-4eac-41ce-90b1-749df2c6b1bb', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:08:31 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-8358ad79-d83f-474a-adf1-bb0c554fefe6 req-d61b021f-9e30-428f-b7b2-f5f3e358ecf2 tempest-AttachVolumeNegativeTest-335382434 None] attachment_update completed successfully. Jul 09 14:08:32 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Jul 09 14:08:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8f4085ca-4460-4059-9d0f-d884a84034d7 1073741824" returned: 0 in 1.108s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:08:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8f4085ca-4460-4059-9d0f-d884a84034d7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:08:32 devstack sudo[88865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8f4085ca-4460-4059-9d0f-d884a84034d7 Jul 09 14:08:32 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:08:33 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root Jul 09 14:08:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8f4085ca-4460-4059-9d0f-d884a84034d7" returned: 0 in 0.754s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:08:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:08:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:08:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9907d190-7ad2-41d2-944e-b9d725110846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f4085ca-4460-4059-9d0f-d884a84034d7', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:08:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3e1e68-b345-4b8d-9433-8b381019b656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:08:33 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Volume volume-8f4085ca-4460-4059-9d0f-d884a84034d7 (8f4085ca-4460-4059-9d0f-d884a84034d7): created successfully Jul 09 14:08:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3e1e68-b345-4b8d-9433-8b381019b656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:08:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Flow 'volume_create_manager' (6c118a31-8a4e-49b8-b26b-21eca242d921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:08:33 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-01f7c4d6-d4ac-48c3-b21b-3f73cfa59468 tempest-AttachVolumeShelveTestJSON-447109680 None] Created volume successfully. Jul 09 14:08:43 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=18,cinder:SELECT=22,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:08:43 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=24,cinder:UPDATE=22,cinder:INSERT=3,cinder:DELETE=3 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:08:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-cfb54e26-083f-4d43-b1bd-418a60b06fc2 req-1496b9a4-3040-4161-b221-290f17de3930 tempest-AttachVolumeShelveTestJSON-447109680 None] No connector for attachment 9649f8eb-b82b-4b00-b2c3-ceb8de924c9a; skipping storage backend terminate_connection call. {{(pid=87011) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 09 14:08:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-cfb54e26-083f-4d43-b1bd-418a60b06fc2 req-1496b9a4-3040-4161-b221-290f17de3930 tempest-AttachVolumeShelveTestJSON-447109680 None] Deleting attachment 9649f8eb-b82b-4b00-b2c3-ceb8de924c9a. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:09:05 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=2 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:09:05 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:09:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:09:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:09:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:09:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:09:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:09:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:09:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:09:12 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:09:12 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:09:14 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Jul 09 14:09:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.641s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:09:14 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Flow 'volume_create_manager' (07a468e5-0994-4c56-840b-578f3715d386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb7558d-a174-42a6-b291-e22f0b06a145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb7558d-a174-42a6-b291-e22f0b06a145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-209199464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e288dd-75a2-4c85-b50b-5700d55b87ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ef2d5e38d14f6aaca8828783753ecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:09:15Z,use_quota=True,user_id='551772e423344bba85d95b58a3eb7321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d99f7ea3-f6eb-4d65-8275-2ad98b488487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d99f7ea3-f6eb-4d65-8275-2ad98b488487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797bb252-1dc0-4a02-b517-fdad7d63dff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797bb252-1dc0-4a02-b517-fdad7d63dff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54e288dd-75a2-4c85-b50b-5700d55b87ea', 'volume_name': 'volume-54e288dd-75a2-4c85-b50b-5700d55b87ea', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a18ac2c-afd5-4286-bdda-5c7d9bdde131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a18ac2c-afd5-4286-bdda-5c7d9bdde131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd07267-1f0d-4026-9481-4aa27af19285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:09:15 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Volume 54e288dd-75a2-4c85-b50b-5700d55b87ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54e288dd-75a2-4c85-b50b-5700d55b87ea', 'volume_size': 1} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-209199464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54e288dd-75a2-4c85-b50b-5700d55b87ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ef2d5e38d14f6aaca8828783753ecf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:09:15Z,use_quota=True,user_id='551772e423344bba85d95b58a3eb7321',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Creating volume 54e288dd-75a2-4c85-b50b-5700d55b87ea {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:09:15 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:09:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54e288dd-75a2-4c85-b50b-5700d55b87ea 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:09:15 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54e288dd-75a2-4c85-b50b-5700d55b87ea 1073741824 Jul 09 14:09:15 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:09:17 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Jul 09 14:09:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54e288dd-75a2-4c85-b50b-5700d55b87ea 1073741824" returned: 0 in 1.925s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:09:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54e288dd-75a2-4c85-b50b-5700d55b87ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:09:17 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54e288dd-75a2-4c85-b50b-5700d55b87ea Jul 09 14:09:17 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:09:18 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Jul 09 14:09:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54e288dd-75a2-4c85-b50b-5700d55b87ea" returned: 0 in 1.046s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:09:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] <== create_volume: return (3040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:09:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.045s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:09:18 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd07267-1f0d-4026-9481-4aa27af19285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54e288dd-75a2-4c85-b50b-5700d55b87ea', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:09:18 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354795db-af9d-45d8-b91f-338c494454a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:09:18 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Volume volume-54e288dd-75a2-4c85-b50b-5700d55b87ea (54e288dd-75a2-4c85-b50b-5700d55b87ea): created successfully Jul 09 14:09:18 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354795db-af9d-45d8-b91f-338c494454a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:09:18 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Flow 'volume_create_manager' (07a468e5-0994-4c56-840b-578f3715d386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:09:18 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d4452436-e92c-4af9-9dcd-a9648061fd70 tempest-VolumesAdminNegativeTest-807810176 None] Created volume successfully. Jul 09 14:09:20 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] Acquiring lock "cinder-54e288dd-75a2-4c85-b50b-5700d55b87ea-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:09:20 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] Lock "cinder-54e288dd-75a2-4c85-b50b-5700d55b87ea-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:09:20 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] Acquiring lock "cinder-quobyte-54e288dd-75a2-4c85-b50b-5700d55b87ea" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:09:20 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] Lock "cinder-quobyte-54e288dd-75a2-4c85-b50b-5700d55b87ea" acquired by "delete_volume" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:09:20 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[05483f57-8c5c-4d1b-8789-7cae6a11d478]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:09:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54e288dd-75a2-4c85-b50b-5700d55b87ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:09:20 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54e288dd-75a2-4c85-b50b-5700d55b87ea Jul 09 14:09:20 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:09:22 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Jul 09 14:09:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54e288dd-75a2-4c85-b50b-5700d55b87ea" returned: 0 in 1.976s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:09:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54e288dd-75a2-4c85-b50b-5700d55b87ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:09:22 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54e288dd-75a2-4c85-b50b-5700d55b87ea Jul 09 14:09:22 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:09:23 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Jul 09 14:09:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54e288dd-75a2-4c85-b50b-5700d55b87ea" returned: 0 in 1.189s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:09:23 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] Lock "cinder-quobyte-54e288dd-75a2-4c85-b50b-5700d55b87ea" released by "delete_volume" :: held 3.231s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:09:23 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] Created reservations ['f940af71-41b3-4f62-bfac-1b654b655fe8', '3772cb18-19cf-4469-8efb-152a87c1a09e', '43ebc0a6-896b-4c5e-83a2-b8e4befc0305', '772cf3ec-0051-4614-86bb-ed4cc78b7e3a'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:09:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:09:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:09:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:09:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:09:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:09:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:09:23 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:09:23 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:09:24 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Jul 09 14:09:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.020s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:09:24 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:09:24 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] Deleted volume successfully. Jul 09 14:09:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-731a33f7-7e95-42d9-9d7a-35ffaa067acc tempest-VolumesAdminNegativeTest-807810176 None] Lock "cinder-54e288dd-75a2-4c85-b50b-5700d55b87ea-delete_volume" released by "delete_volume" :: held 4.521s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:09:33 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=10,cinder:SELECT=7,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:09:34 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Flow 'volume_create_manager' (461085eb-3509-4d1f-b3dd-0b725524bc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1ba6a9-894b-4877-bbc6-d41ee7e1092e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1ba6a9-894b-4877-bbc6-d41ee7e1092e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-892418578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b95738-60cd-49db-accf-8e639a4de844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e90b66f51cb403f80f528ad72ee5791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:09:43Z,use_quota=True,user_id='cc1157a78180428a8f00c022ec2aa3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10da2c0-f172-412e-9034-a4ecd53665bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10da2c0-f172-412e-9034-a4ecd53665bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d66ebe3-229e-45aa-98ff-be6e4a200ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d66ebe3-229e-45aa-98ff-be6e4a200ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3b95738-60cd-49db-accf-8e639a4de844', 'volume_name': 'volume-c3b95738-60cd-49db-accf-8e639a4de844', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d029e5-4f1b-4c73-a831-b957cb62f319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d029e5-4f1b-4c73-a831-b957cb62f319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd21a18-5d5a-4855-a1d1-6069dc484e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:09:43 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Volume c3b95738-60cd-49db-accf-8e639a4de844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3b95738-60cd-49db-accf-8e639a4de844', 'volume_size': 1} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-892418578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3b95738-60cd-49db-accf-8e639a4de844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e90b66f51cb403f80f528ad72ee5791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:09:43Z,use_quota=True,user_id='cc1157a78180428a8f00c022ec2aa3f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Creating volume c3b95738-60cd-49db-accf-8e639a4de844 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:09:43 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:09:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c3b95738-60cd-49db-accf-8e639a4de844 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:09:43 devstack sudo[89831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c3b95738-60cd-49db-accf-8e639a4de844 1073741824 Jul 09 14:09:43 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:09:44 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-92dadec5-d876-4faf-b7a9-bbe10129e4be req-3fa6e3c0-f655-47a9-9872-2d29fc4271b1 tempest-AttachVolumeNegativeTest-335382434 None] Terminate volume connection completed successfully. Jul 09 14:09:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-92dadec5-d876-4faf-b7a9-bbe10129e4be req-3fa6e3c0-f655-47a9-9872-2d29fc4271b1 tempest-AttachVolumeNegativeTest-335382434 None] Deleting attachment 0d2b30d9-4eac-41ce-90b1-749df2c6b1bb. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:09:44 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root Jul 09 14:09:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c3b95738-60cd-49db-accf-8e639a4de844 1073741824" returned: 0 in 1.140s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:09:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c3b95738-60cd-49db-accf-8e639a4de844 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:09:44 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c3b95738-60cd-49db-accf-8e639a4de844 Jul 09 14:09:44 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:09:45 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Jul 09 14:09:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c3b95738-60cd-49db-accf-8e639a4de844" returned: 0 in 0.760s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:09:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:09:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:09:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd21a18-5d5a-4855-a1d1-6069dc484e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3b95738-60cd-49db-accf-8e639a4de844', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:09:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ecfbaa0-1ef3-4723-b1cc-b509f950615f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:09:45 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Volume volume-c3b95738-60cd-49db-accf-8e639a4de844 (c3b95738-60cd-49db-accf-8e639a4de844): created successfully Jul 09 14:09:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ecfbaa0-1ef3-4723-b1cc-b509f950615f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:09:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Flow 'volume_create_manager' (461085eb-3509-4d1f-b3dd-0b725524bc34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:09:45 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-eb447429-1d42-41c4-89b3-9c404eadc492 tempest-ServerActionsTestOtherA-1241304218 None] Created volume successfully. Jul 09 14:09:55 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:09:55 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:09:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] Acquiring lock "cinder-8f4085ca-4460-4059-9d0f-d884a84034d7-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:09:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] Lock "cinder-8f4085ca-4460-4059-9d0f-d884a84034d7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:09:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] Acquiring lock "cinder-quobyte-8f4085ca-4460-4059-9d0f-d884a84034d7" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:09:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] Lock "cinder-quobyte-8f4085ca-4460-4059-9d0f-d884a84034d7" acquired by "delete_volume" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:09:59 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ccd09d-eed1-41c8-98c7-08a67ecab54a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:09:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8f4085ca-4460-4059-9d0f-d884a84034d7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:09:59 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8f4085ca-4460-4059-9d0f-d884a84034d7 Jul 09 14:09:59 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:00 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8f4085ca-4460-4059-9d0f-d884a84034d7" returned: 0 in 0.944s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8f4085ca-4460-4059-9d0f-d884a84034d7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:00 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8f4085ca-4460-4059-9d0f-d884a84034d7 Jul 09 14:10:00 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:01 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8f4085ca-4460-4059-9d0f-d884a84034d7" returned: 0 in 0.964s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] Lock "cinder-quobyte-8f4085ca-4460-4059-9d0f-d884a84034d7" released by "delete_volume" :: held 1.980s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:10:01 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] Created reservations ['ae2494ea-9c47-4b48-aeb6-dee89d6997d7', '8b1405fa-b35a-4b9e-86ff-1e92185bd553', 'e7efcf26-03c1-4350-a238-9f73b6c0a1c8', 'b45c7804-478a-42b6-922e-c927b1c7a5ee'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:10:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:10:01 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:10:01 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:10:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:10:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:01 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:10:01 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:02 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.999s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:02 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:10:02 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] Deleted volume successfully. Jul 09 14:10:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d412b5ee-16a7-4e7b-8d4a-0688b36593fc tempest-AttachVolumeShelveTestJSON-447109680 None] Lock "cinder-8f4085ca-4460-4059-9d0f-d884a84034d7-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:10:11 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=6,cinder:SELECT=7,cinder:INSERT=3 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:10:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:10:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:10:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:10:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:10:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:10:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:12 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:10:12 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:12 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:10:13 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.288s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:10:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:10:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 8 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:10:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Flow 'volume_create_manager' (03dfbe13-abe9-4b96-99ac-25e2b0bce7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a61f08-24d1-4e8c-9127-5e111449b49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a61f08-24d1-4e8c-9127-5e111449b49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-819359022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28dc7904-311b-4de9-82fd-538e2b2a475f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6aafa5fcf4644558d404e6361611830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:10:14Z,use_quota=True,user_id='3a06c5c959494ed1bf363c7ffce694b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df31dd4a-2b96-4128-ac3d-a68098f6525c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df31dd4a-2b96-4128-ac3d-a68098f6525c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (636c51b8-8794-4c96-bd9e-8bf01818f9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (636c51b8-8794-4c96-bd9e-8bf01818f9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28dc7904-311b-4de9-82fd-538e2b2a475f', 'volume_name': 'volume-28dc7904-311b-4de9-82fd-538e2b2a475f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d4dd2b-cccc-4e3c-916c-b82be466195c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d4dd2b-cccc-4e3c-916c-b82be466195c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b734626a-b876-4a93-9c17-50e93df5d4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:14 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Volume 28dc7904-311b-4de9-82fd-538e2b2a475f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28dc7904-311b-4de9-82fd-538e2b2a475f', 'volume_size': 1} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-819359022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28dc7904-311b-4de9-82fd-538e2b2a475f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6aafa5fcf4644558d404e6361611830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:10:14Z,use_quota=True,user_id='3a06c5c959494ed1bf363c7ffce694b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Creating volume 28dc7904-311b-4de9-82fd-538e2b2a475f {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:10:14 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:10:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:14 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f 1073741824 Jul 09 14:10:14 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:15 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f 1073741824" returned: 0 in 0.941s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:15 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f Jul 09 14:10:15 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:16 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f" returned: 0 in 0.765s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:10:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:10:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b734626a-b876-4a93-9c17-50e93df5d4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28dc7904-311b-4de9-82fd-538e2b2a475f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c11384-70be-475f-ba8f-94c5feef9e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:16 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Volume volume-28dc7904-311b-4de9-82fd-538e2b2a475f (28dc7904-311b-4de9-82fd-538e2b2a475f): created successfully Jul 09 14:10:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c11384-70be-475f-ba8f-94c5feef9e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Flow 'volume_create_manager' (03dfbe13-abe9-4b96-99ac-25e2b0bce7f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:10:16 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-9f64b813-d236-4e42-aad1-8f2204042dad req-cc9021b0-3dae-4479-889a-f3bee436eef6 tempest-VolumesSnapshotsTestJSON-986493406 None] Created volume successfully. Jul 09 14:10:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:10:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] Creating offline snapshot 74c87827-f442-4d7a-b9b8-dd74eb41d4bd of volume 28dc7904-311b-4de9-82fd-538e2b2a475f {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:10:16 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[752e88b8-5ffc-4267-8cc2-f01731bd17ab]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:10:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:17 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f Jul 09 14:10:17 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:17 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f" returned: 0 in 1.001s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:17 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd 1G Jul 09 14:10:17 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:18 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd 1G" returned: 0 in 0.926s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28dc7904-311b-4de9-82fd-538e2b2a475f -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:18 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28dc7904-311b-4de9-82fd-538e2b2a475f -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd Jul 09 14:10:18 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:19 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28dc7904-311b-4de9-82fd-538e2b2a475f -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd" returned: 0 in 0.881s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:19 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd is being set with open permissions: ugo+rw Jul 09 14:10:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:19 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd Jul 09 14:10:19 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:20 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd" returned: 0 in 1.006s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:20 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.info Jul 09 14:10:20 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:21 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.info" returned: 0 in 1.092s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:21 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.info is being set with open permissions: ugo+rw Jul 09 14:10:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:21 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.info Jul 09 14:10:21 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:23 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.info" returned: 0 in 1.260s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.302s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:10:23 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-23ea73d5-02bd-4974-bec7-5b5e848f8c21 req-30c6b441-c976-4cb2-b300-6363810374f8 tempest-VolumesSnapshotsTestJSON-986493406 None] Create snapshot completed successfully Jul 09 14:10:23 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] Acquiring lock "cinder-74c87827-f442-4d7a-b9b8-dd74eb41d4bd-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:10:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] Lock "cinder-74c87827-f442-4d7a-b9b8-dd74eb41d4bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:10:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] Acquiring lock "cinder-quobyte-28dc7904-311b-4de9-82fd-538e2b2a475f" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:10:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] Lock "cinder-quobyte-28dc7904-311b-4de9-82fd-538e2b2a475f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:10:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] Acquiring lock "cinder-quobyte-74c87827-f442-4d7a-b9b8-dd74eb41d4bd" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:10:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] Lock "cinder-quobyte-74c87827-f442-4d7a-b9b8-dd74eb41d4bd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:10:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] Deleting offline snapshot 74c87827-f442-4d7a-b9b8-dd74eb41d4bd of volume 28dc7904-311b-4de9-82fd-538e2b2a475f {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:10:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] snapshot_file for this snap is: volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:10:24 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9d86eb-1d37-4f43-a296-4d5f3f2131f0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:10:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:24 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd Jul 09 14:10:24 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:25 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd" returned: 0 in 0.874s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28dc7904-311b-4de9-82fd-538e2b2a475f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[706ef0bb-a945-4f19-b9c0-b8bda218c43c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:25 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f Jul 09 14:10:25 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Flow 'volume_create_manager' (a424f279-1d3b-491d-ad08-6618359ec4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00f1fc2-04ce-4a23-8fbf-0d0a741feae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00f1fc2-04ce-4a23-8fbf-0d0a741feae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1932341471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57cf729c-0006-4cfc-a1d7-cc8295c3fd79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2fb4f6774d0479e90a04bfb374c3df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:10:25Z,use_quota=True,user_id='6e16e12ef4a641a385a1c29957a49551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056aba60-5f4f-498b-980d-8c62a9a16f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056aba60-5f4f-498b-980d-8c62a9a16f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aaf2547-0bf8-46d3-9ba2-a9d4c48baed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aaf2547-0bf8-46d3-9ba2-a9d4c48baed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57cf729c-0006-4cfc-a1d7-cc8295c3fd79', 'volume_name': 'volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7831a29-ec19-4e6c-9932-a31a4c0d0aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7831a29-ec19-4e6c-9932-a31a4c0d0aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceaecab6-b58f-4c47-857f-c032d7e9c041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:25 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Volume 57cf729c-0006-4cfc-a1d7-cc8295c3fd79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79', 'volume_size': 1} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1932341471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57cf729c-0006-4cfc-a1d7-cc8295c3fd79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2fb4f6774d0479e90a04bfb374c3df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:10:25Z,use_quota=True,user_id='6e16e12ef4a641a385a1c29957a49551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Creating volume 57cf729c-0006-4cfc-a1d7-cc8295c3fd79 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:10:25 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:25 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79 1073741824 Jul 09 14:10:25 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:25 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f" returned: 0 in 0.882s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:25 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd Jul 09 14:10:25 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:26 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79 1073741824" returned: 0 in 1.070s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:26 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79 Jul 09 14:10:26 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:26 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd" returned: 0 in 0.933s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:26 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd Jul 09 14:10:26 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:27 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79" returned: 0 in 0.702s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:27 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:10:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:10:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceaecab6-b58f-4c47-857f-c032d7e9c041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249bc6a1-9687-49fc-8d06-f27c55b64e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:27 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Volume volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79 (57cf729c-0006-4cfc-a1d7-cc8295c3fd79): created successfully Jul 09 14:10:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249bc6a1-9687-49fc-8d06-f27c55b64e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Flow 'volume_create_manager' (a424f279-1d3b-491d-ad08-6618359ec4a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:10:27 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a22e5d76-0073-4d59-8096-0652cbafb780 tempest-TaggedAttachmentsTest-1303787514 None] Created volume successfully. Jul 09 14:10:27 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f.74c87827-f442-4d7a-b9b8-dd74eb41d4bd" returned: 0 in 0.675s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] Lock "cinder-quobyte-74c87827-f442-4d7a-b9b8-dd74eb41d4bd" released by "_delete_snapshot" :: held 3.517s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:10:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] Lock "cinder-quobyte-28dc7904-311b-4de9-82fd-538e2b2a475f" released by "delete_snapshot" :: held 3.544s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:10:27 devstack cinder-volume[87011]: WARNING cinder.quota [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:10:27 devstack cinder-volume[87011]: DEBUG cinder.quota [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] Created reservations ['a9cb0e88-f371-4752-a6b4-b64629609e40', '6c8f933c-5347-4d8c-ba24-63b0048846b6', '6f263d2b-5ed2-4250-b5b3-7dc04af75802', 'b39384df-4151-40fc-a04b-abd323a4a71e'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:10:27 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] Delete snapshot completed successfully. Jul 09 14:10:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-3ab57e65-2526-4765-add3-6a5e0a9e875a req-39d803cc-c671-4720-91a2-db31972abc0f tempest-VolumesSnapshotsTestJSON-986493406 None] Lock "cinder-74c87827-f442-4d7a-b9b8-dd74eb41d4bd-delete_snapshot" released by "delete_snapshot" :: held 3.779s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:10:28 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] Acquiring lock "cinder-28dc7904-311b-4de9-82fd-538e2b2a475f-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:10:28 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] Lock "cinder-28dc7904-311b-4de9-82fd-538e2b2a475f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:10:28 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] Acquiring lock "cinder-quobyte-28dc7904-311b-4de9-82fd-538e2b2a475f" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:10:28 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] Lock "cinder-quobyte-28dc7904-311b-4de9-82fd-538e2b2a475f" acquired by "delete_volume" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:10:28 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[814f973e-d196-4d59-95fe-d591c7f89318]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:10:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:28 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f Jul 09 14:10:28 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:29 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f" returned: 0 in 0.814s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:29 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f Jul 09 14:10:29 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:30 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-28dc7904-311b-4de9-82fd-538e2b2a475f" returned: 0 in 0.688s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] Lock "cinder-quobyte-28dc7904-311b-4de9-82fd-538e2b2a475f" released by "delete_volume" :: held 1.571s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:10:30 devstack cinder-volume[87011]: DEBUG cinder.quota [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] Created reservations ['0d838c3e-4f46-4d20-b2b5-554ce84ed798', 'a17e0b92-7d76-449d-b6b8-08b5d7d4b7c4', 'bf57c4c0-4aea-45c0-8744-28f2e97fb751', 'bc346070-d178-43a4-918f-6f8583131603'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:10:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:10:30 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:10:30 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:10:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:10:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:30 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:10:30 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:31 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.803s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:31 devstack cinder-volume[87011]: DEBUG cinder.manager [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:10:31 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] Deleted volume successfully. Jul 09 14:10:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-0f12af2e-6746-4abf-8812-ee36034607d2 req-8c6fe275-9b00-4204-92c4-47946b9dedb0 tempest-VolumesSnapshotsTestJSON-986493406 None] Lock "cinder-28dc7904-311b-4de9-82fd-538e2b2a475f-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:10:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-1384e59c-021a-42ef-84ba-f66887afdfbe req-468e1f00-02aa-4dc4-b591-560ecf80b90d tempest-ServerActionsTestOtherA-1241304218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-1384e59c-021a-42ef-84ba-f66887afdfbe req-468e1f00-02aa-4dc4-b591-560ecf80b90d tempest-ServerActionsTestOtherA-1241304218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:10:31 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bf48c7-7746-496d-b290-17ff7a6a6be8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:10:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-1384e59c-021a-42ef-84ba-f66887afdfbe req-468e1f00-02aa-4dc4-b591-560ecf80b90d tempest-ServerActionsTestOtherA-1241304218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c3b95738-60cd-49db-accf-8e639a4de844 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:31 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c3b95738-60cd-49db-accf-8e639a4de844 Jul 09 14:10:31 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:32 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-1384e59c-021a-42ef-84ba-f66887afdfbe req-468e1f00-02aa-4dc4-b591-560ecf80b90d tempest-ServerActionsTestOtherA-1241304218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c3b95738-60cd-49db-accf-8e639a4de844" returned: 0 in 1.090s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-1384e59c-021a-42ef-84ba-f66887afdfbe req-468e1f00-02aa-4dc4-b591-560ecf80b90d tempest-ServerActionsTestOtherA-1241304218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.110s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:10:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-1384e59c-021a-42ef-84ba-f66887afdfbe req-468e1f00-02aa-4dc4-b591-560ecf80b90d tempest-ServerActionsTestOtherA-1241304218 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-c3b95738-60cd-49db-accf-8e639a4de844', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dcde3af9-9acb-47cd-ac63-704bf4824311', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:10:32 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-1384e59c-021a-42ef-84ba-f66887afdfbe req-468e1f00-02aa-4dc4-b591-560ecf80b90d tempest-ServerActionsTestOtherA-1241304218 None] attachment_update completed successfully. Jul 09 14:10:35 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ebce498c-3b9f-4bf3-865c-4ad691ed3919 tempest-GroupSnapshotsTest-1287877168 None] Group tempest-GroupSnapshotsTest-Group-960709096: creating Jul 09 14:10:35 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ebce498c-3b9f-4bf3-865c-4ad691ed3919 tempest-GroupSnapshotsTest-1287877168 None] Group tempest-GroupSnapshotsTest-Group-960709096: created successfully Jul 09 14:10:35 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ebce498c-3b9f-4bf3-865c-4ad691ed3919 tempest-GroupSnapshotsTest-1287877168 None] Create group completed successfully. Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Flow 'volume_create_manager' (32f0b2f7-d00b-4a23-8539-b9b0986d77ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c8db59-9a93-4d6b-9dcc-71aa5b07856d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c8db59-9a93-4d6b-9dcc-71aa5b07856d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-987311905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83370bc9-48af-40bc-9830-9be68b8be5e5,host='devstack@QuobyteHD#QuobyteHD',id=43da6fb6-9c86-4c8d-9d5d-6c9dc232099f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c29ab42494868a63d01e0aa798056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:10:37Z,use_quota=True,user_id='8a30500deda44cfc93d273873f80ed7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d2c9095-1729-46d1-98a9-7134341e2f6f),volume_type_id=1d2c9095-1729-46d1-98a9-7134341e2f6f)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61b48f1-685b-42ba-bda0-4cae090bbfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61b48f1-685b-42ba-bda0-4cae090bbfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3220a368-c718-4ecf-86ef-7e94dafb4dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3220a368-c718-4ecf-86ef-7e94dafb4dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43da6fb6-9c86-4c8d-9d5d-6c9dc232099f', 'volume_name': 'volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab9b7b6-7fb7-4d19-b2eb-72d58e2da7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab9b7b6-7fb7-4d19-b2eb-72d58e2da7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f30ca01b-ea28-4278-8ab4-3ef9e3fc3aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:37 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Volume 43da6fb6-9c86-4c8d-9d5d-6c9dc232099f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f', 'volume_size': 1} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=83370bc9-48af-40bc-9830-9be68b8be5e5,created_at=2026-07-09T12:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-987311905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83370bc9-48af-40bc-9830-9be68b8be5e5,host='devstack@QuobyteHD#QuobyteHD',id=43da6fb6-9c86-4c8d-9d5d-6c9dc232099f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c29ab42494868a63d01e0aa798056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:10:37Z,use_quota=True,user_id='8a30500deda44cfc93d273873f80ed7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d2c9095-1729-46d1-98a9-7134341e2f6f),volume_type_id=1d2c9095-1729-46d1-98a9-7134341e2f6f)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Creating volume 43da6fb6-9c86-4c8d-9d5d-6c9dc232099f {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:10:37 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:10:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:37 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f 1073741824 Jul 09 14:10:37 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:38 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f 1073741824" returned: 0 in 1.012s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:38 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f Jul 09 14:10:38 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:39 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f" returned: 0 in 0.724s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:10:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:10:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f30ca01b-ea28-4278-8ab4-3ef9e3fc3aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42075bdf-b23b-437e-8ca3-1ddca9173575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:39 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Volume volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f (43da6fb6-9c86-4c8d-9d5d-6c9dc232099f): created successfully Jul 09 14:10:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42075bdf-b23b-437e-8ca3-1ddca9173575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Flow 'volume_create_manager' (32f0b2f7-d00b-4a23-8539-b9b0986d77ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:10:39 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-7dce5d09-dfaf-490e-973a-8fb2334dcafd tempest-GroupSnapshotsTest-1287877168 None] Created volume successfully. Jul 09 14:10:40 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] GroupSnapshot ad67bd9e-9c27-49e5-a875-eaf0d68e05f1: creating. Jul 09 14:10:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] Group snapshot ad67bd9e-9c27-49e5-a875-eaf0d68e05f1: creating. {{(pid=87011) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 14:10:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:10:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] Creating offline snapshot 89940432-4fb5-44a3-9c50-3f7e80b69888 of volume 43da6fb6-9c86-4c8d-9d5d-6c9dc232099f {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:10:40 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c0ee6c-5193-4ab9-8f51-d619ab541878]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:10:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:40 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f Jul 09 14:10:40 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:41 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-c82fc8b6-c1a9-42d8-8904-ab8b8578098b req-b1e7ed9f-9771-4baa-a8c7-b91f17024793 tempest-ServerActionsTestOtherA-1241304218 None] Terminate volume connection completed successfully. Jul 09 14:10:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-c82fc8b6-c1a9-42d8-8904-ab8b8578098b req-b1e7ed9f-9771-4baa-a8c7-b91f17024793 tempest-ServerActionsTestOtherA-1241304218 None] Deleting attachment dcde3af9-9acb-47cd-ac63-704bf4824311. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:10:41 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f" returned: 0 in 0.941s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:41 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888 1G Jul 09 14:10:41 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:42 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888 1G" returned: 0 in 0.969s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:42 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888 Jul 09 14:10:42 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:43 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888" returned: 0 in 0.937s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:43 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 14:10:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:43 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888 Jul 09 14:10:43 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-c82fc8b6-c1a9-42d8-8904-ab8b8578098b req-a46d9ee0-e8ad-4cdf-ae2e-907aa476926c tempest-ServerActionsTestOtherA-1241304218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:43 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888" returned: 0 in 0.687s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:43 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.info Jul 09 14:10:43 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:44 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.info" returned: 0 in 0.787s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:44 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 14:10:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:44 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.info Jul 09 14:10:44 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:44 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:10:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Flow 'volume_create_manager' (0dd32ee9-ac14-4ea5-9e50-1754c5e5b591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:10:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216e531b-92de-4eae-8e73-218439a15015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216e531b-92de-4eae-8e73-218439a15015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-47748797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874af085-b658-4437-a67a-aeef6d095e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9986ea392cb94b35b696c956d33f27f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:10:45Z,use_quota=True,user_id='738381f58f9647b2b55e7283075b7bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e428486-f4fe-43cb-85cb-11103056b4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e428486-f4fe-43cb-85cb-11103056b4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78473169-8c12-4287-8942-47f0eeb99124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78473169-8c12-4287-8942-47f0eeb99124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '874af085-b658-4437-a67a-aeef6d095e34', 'volume_name': 'volume-874af085-b658-4437-a67a-aeef6d095e34', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c18b06-471c-4a8c-8b1a-b83ddbf20a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c18b06-471c-4a8c-8b1a-b83ddbf20a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a21f312-e339-414b-b006-5674f5cd522c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:44 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Volume 874af085-b658-4437-a67a-aeef6d095e34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-874af085-b658-4437-a67a-aeef6d095e34', 'volume_size': 1} Jul 09 14:10:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:45 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.info" returned: 0 in 0.703s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.109s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:10:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-c82fc8b6-c1a9-42d8-8904-ab8b8578098b req-a46d9ee0-e8ad-4cdf-ae2e-907aa476926c tempest-ServerActionsTestOtherA-1241304218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.638s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:10:45 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8695bf-c70d-4010-91e7-d5d6d6875395]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:10:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-c82fc8b6-c1a9-42d8-8904-ab8b8578098b req-a46d9ee0-e8ad-4cdf-ae2e-907aa476926c tempest-ServerActionsTestOtherA-1241304218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c3b95738-60cd-49db-accf-8e639a4de844 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:45 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b1473b1d-b55e-40cd-8b82-12c1633d1003 tempest-GroupSnapshotsTest-1287877168 None] group_snapshot ad67bd9e-9c27-49e5-a875-eaf0d68e05f1: created successfully Jul 09 14:10:45 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c3b95738-60cd-49db-accf-8e639a4de844 Jul 09 14:10:45 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:46 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-c82fc8b6-c1a9-42d8-8904-ab8b8578098b req-a46d9ee0-e8ad-4cdf-ae2e-907aa476926c tempest-ServerActionsTestOtherA-1241304218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c3b95738-60cd-49db-accf-8e639a4de844" returned: 0 in 0.907s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-c82fc8b6-c1a9-42d8-8904-ab8b8578098b req-a46d9ee0-e8ad-4cdf-ae2e-907aa476926c tempest-ServerActionsTestOtherA-1241304218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.935s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:10:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.422s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:10:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-47748797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874af085-b658-4437-a67a-aeef6d095e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9986ea392cb94b35b696c956d33f27f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:10:45Z,use_quota=True,user_id='738381f58f9647b2b55e7283075b7bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:10:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Creating volume 874af085-b658-4437-a67a-aeef6d095e34 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:10:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:10:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:10:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:10:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:10:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:10:46 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:10:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-874af085-b658-4437-a67a-aeef6d095e34 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:46 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-874af085-b658-4437-a67a-aeef6d095e34 1073741824 Jul 09 14:10:46 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-c82fc8b6-c1a9-42d8-8904-ab8b8578098b req-a46d9ee0-e8ad-4cdf-ae2e-907aa476926c tempest-ServerActionsTestOtherA-1241304218 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-c3b95738-60cd-49db-accf-8e639a4de844', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02dd1484-2a81-4dfa-a063-c98aecccfdad', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:10:46 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-c82fc8b6-c1a9-42d8-8904-ab8b8578098b req-a46d9ee0-e8ad-4cdf-ae2e-907aa476926c tempest-ServerActionsTestOtherA-1241304218 None] attachment_update completed successfully. Jul 09 14:10:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:47 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-874af085-b658-4437-a67a-aeef6d095e34 1073741824" returned: 0 in 1.190s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-874af085-b658-4437-a67a-aeef6d095e34 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:47 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-874af085-b658-4437-a67a-aeef6d095e34 Jul 09 14:10:47 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:48 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-874af085-b658-4437-a67a-aeef6d095e34" returned: 0 in 0.968s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.218s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.244s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "cinder-quobyte-89940432-4fb5-44a3-9c50-3f7e80b69888-00eba10d-9b38-4432-9037-033651705935" by "_create_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a21f312-e339-414b-b006-5674f5cd522c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-874af085-b658-4437-a67a-aeef6d095e34', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cb3519-32a9-40ff-8e47-eb7d3ee9dbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-89940432-4fb5-44a3-9c50-3f7e80b69888-00eba10d-9b38-4432-9037-033651705935" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Creating volume 00eba10d-9b38-4432-9037-033651705935 from snapshot 89940432-4fb5-44a3-9c50-3f7e80b69888 {{(pid=87011) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "cinder-quobyte-00eba10d-9b38-4432-9037-033651705935" by "_copy_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:10:48 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Volume volume-874af085-b658-4437-a67a-aeef6d095e34 (874af085-b658-4437-a67a-aeef6d095e34): created successfully Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cb3519-32a9-40ff-8e47-eb7d3ee9dbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Flow 'volume_create_manager' (0dd32ee9-ac14-4ea5-9e50-1754c5e5b591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:10:48 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-3790bf80-7965-470e-8580-def8bbf76c54 tempest-AttachVolumeNegativeTest-335382434 None] Created volume successfully. Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-00eba10d-9b38-4432-9037-033651705935" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] snapshot: 89940432-4fb5-44a3-9c50-3f7e80b69888, volume: 00eba10d-9b38-4432-9037-033651705935, {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[24da85af-59e6-46e5-ae1d-d95c68789925]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:10:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:49 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888 Jul 09 14:10:49 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:50 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888" returned: 0 in 1.518s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:10:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 14:10:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Creating direct copy from snapshot {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 14:10:50 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b160ff-0899-4a7b-95ec-74a02676e32a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:10:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:50 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f Jul 09 14:10:50 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:51 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f" returned: 0 in 1.237s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:51 devstack cinder-volume[87011]: DEBUG cinder.utils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Path /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00eba10d-9b38-4432-9037-033651705935 not found in is_blk_device check {{(pid=87011) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 14:10:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00eba10d-9b38-4432-9037-033651705935 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:10:51 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00eba10d-9b38-4432-9037-033651705935 Jul 09 14:10:51 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:10:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-3c91e70f-6f53-45e3-9542-97347c11beca req-d9f8fd1e-2f36-4f63-9be1-a4f917deb7c5 tempest-AttachVolumeNegativeTest-335382434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:10:59 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Jul 09 14:10:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00eba10d-9b38-4432-9037-033651705935" returned: 0 in 8.291s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:10:59 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8be9ef1-d17e-4ba0-8632-71e346e9b05a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:10:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:00 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f Jul 09 14:11:00 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:00 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f" returned: 0 in 0.913s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:00 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f, size 1024.00 MB, duration 8.29 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00eba10d-9b38-4432-9037-033651705935 {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:11:00 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Converted 1024.00 MB image at 123.49 MB/s Jul 09 14:11:00 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00eba10d-9b38-4432-9037-033651705935 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 14:11:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00eba10d-9b38-4432-9037-033651705935 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:00 devstack sudo[91459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00eba10d-9b38-4432-9037-033651705935 Jul 09 14:11:00 devstack sudo[91459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:01 devstack sudo[91459]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00eba10d-9b38-4432-9037-033651705935" returned: 0 in 0.601s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-00eba10d-9b38-4432-9037-033651705935" released by "_copy_volume_from_snapshot" :: held 12.807s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:11:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-89940432-4fb5-44a3-9c50-3f7e80b69888-00eba10d-9b38-4432-9037-033651705935" released by "_create_volume_from_snapshot" :: held 12.879s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:11:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.923s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:11:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-3c91e70f-6f53-45e3-9542-97347c11beca req-d9f8fd1e-2f36-4f63-9be1-a4f917deb7c5 tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.806s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:11:01 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd040964-16dc-4a94-b382-c41264dc9d10]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:11:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-3c91e70f-6f53-45e3-9542-97347c11beca req-d9f8fd1e-2f36-4f63-9be1-a4f917deb7c5 tempest-AttachVolumeNegativeTest-335382434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-874af085-b658-4437-a67a-aeef6d095e34 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:01 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-5777b710-7ac5-46c8-8cb3-331d522c7d01 tempest-GroupSnapshotsTest-1287877168 None] Create group from source-snapshot-ad67bd9e-9c27-49e5-a875-eaf0d68e05f1 completed successfully. Jul 09 14:11:01 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-874af085-b658-4437-a67a-aeef6d095e34 Jul 09 14:11:01 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:02 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-3c91e70f-6f53-45e3-9542-97347c11beca req-d9f8fd1e-2f36-4f63-9be1-a4f917deb7c5 tempest-AttachVolumeNegativeTest-335382434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-874af085-b658-4437-a67a-aeef6d095e34" returned: 0 in 0.753s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-3c91e70f-6f53-45e3-9542-97347c11beca req-d9f8fd1e-2f36-4f63-9be1-a4f917deb7c5 tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.772s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:11:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-3c91e70f-6f53-45e3-9542-97347c11beca req-d9f8fd1e-2f36-4f63-9be1-a4f917deb7c5 tempest-AttachVolumeNegativeTest-335382434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-874af085-b658-4437-a67a-aeef6d095e34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af0e6f53-8cbf-4e52-a647-0386394d0baf', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:11:02 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-3c91e70f-6f53-45e3-9542-97347c11beca req-d9f8fd1e-2f36-4f63-9be1-a4f917deb7c5 tempest-AttachVolumeNegativeTest-335382434 None] attachment_update completed successfully. Jul 09 14:11:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "cinder-quobyte-00eba10d-9b38-4432-9037-033651705935" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:11:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-00eba10d-9b38-4432-9037-033651705935" acquired by "delete_volume" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:11:02 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb92335c-1a0c-4a95-8a78-a6463ff75560]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:11:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00eba10d-9b38-4432-9037-033651705935 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:02 devstack sudo[91467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00eba10d-9b38-4432-9037-033651705935 Jul 09 14:11:02 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:03 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00eba10d-9b38-4432-9037-033651705935" returned: 0 in 0.778s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00eba10d-9b38-4432-9037-033651705935 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:03 devstack sudo[91475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00eba10d-9b38-4432-9037-033651705935 Jul 09 14:11:03 devstack sudo[91475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:03 devstack sudo[91475]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00eba10d-9b38-4432-9037-033651705935" returned: 0 in 0.631s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-00eba10d-9b38-4432-9037-033651705935" released by "delete_volume" :: held 1.454s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:11:03 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] Created reservations ['0c4ee816-97c5-423b-bf86-0461afbc51f5'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:11:03 devstack cinder-volume[87011]: WARNING cinder.quota [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1641990162 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1641990162, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:11:03 devstack cinder-volume[87011]: WARNING cinder.quota [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1641990162 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1641990162, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:11:04 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] Created reservations ['84046df4-f3dc-4076-b257-eda7737f970b', '4c435fba-e035-4121-bd3c-5e9f80dfd99e', '03fce778-3156-4ee3-bb01-1d6555a14069', 'caf5ee5f-2d76-4817-afdb-aa5b3c9c15c2'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:11:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:11:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:11:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:11:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:11:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:11:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:04 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:11:04 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:04 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.645s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:04 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:11:04 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-4c215ecb-535f-4bb5-a9e2-faad31f212ca tempest-GroupSnapshotsTest-1287877168 None] Delete group completed successfully. Jul 09 14:11:04 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] group_snapshot ad67bd9e-9c27-49e5-a875-eaf0d68e05f1: deleting Jul 09 14:11:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] group_snapshot ad67bd9e-9c27-49e5-a875-eaf0d68e05f1: deleting {{(pid=87011) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 14:11:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "cinder-quobyte-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:11:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:11:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "cinder-quobyte-89940432-4fb5-44a3-9c50-3f7e80b69888" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:11:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-89940432-4fb5-44a3-9c50-3f7e80b69888" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:11:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] Deleting offline snapshot 89940432-4fb5-44a3-9c50-3f7e80b69888 of volume 43da6fb6-9c86-4c8d-9d5d-6c9dc232099f {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:11:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] snapshot_file for this snap is: volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:11:04 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad6c22d-16a4-4d9c-b7c5-8aba90aec794]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:11:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:05 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888 Jul 09 14:11:05 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:05 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888" returned: 0 in 0.744s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:11:05 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[e584d2a7-46ea-4e89-b9a4-ab4846bdc915]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:11:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:05 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f Jul 09 14:11:05 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:06 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f" returned: 0 in 0.986s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:06 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888 Jul 09 14:11:06 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:07 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888" returned: 0 in 0.907s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:07 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888 Jul 09 14:11:07 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:08 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f.89940432-4fb5-44a3-9c50-3f7e80b69888" returned: 0 in 0.703s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:08 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-89940432-4fb5-44a3-9c50-3f7e80b69888" released by "_delete_snapshot" :: held 3.444s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:11:08 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f" released by "delete_snapshot" :: held 3.475s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:11:08 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-17d453d6-e116-45f9-ad6f-88dc506c0492 req-27530121-0a27-4cc8-9e94-13029149b6e4 tempest-AttachVolumeNegativeTest-335382434 None] Terminate volume connection completed successfully. Jul 09 14:11:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-17d453d6-e116-45f9-ad6f-88dc506c0492 req-27530121-0a27-4cc8-9e94-13029149b6e4 tempest-AttachVolumeNegativeTest-335382434 None] Deleting attachment af0e6f53-8cbf-4e52-a647-0386394d0baf. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:11:08 devstack cinder-volume[87011]: WARNING cinder.quota [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1641990162 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1641990162, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:11:08 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] Created reservations ['83581567-51fc-4f66-8672-316e8f7a1583', '4fee8729-827d-4f6a-90cf-dc610985a7e7', '99932960-8702-4677-b0d2-f81e70aea4a7', 'f60d38c1-55bb-4030-8725-2f4a07873ddc'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:11:08 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-dddf4e8b-7a1f-40a4-858d-f22ef9f85fe4 tempest-GroupSnapshotsTest-1287877168 None] group_snapshot ad67bd9e-9c27-49e5-a875-eaf0d68e05f1: deleted successfully Jul 09 14:11:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "cinder-quobyte-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:11:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f" acquired by "delete_volume" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:11:09 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f156b5e3-da9e-4e12-b2f2-b33d155f1826]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:11:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:09 devstack sudo[91524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f Jul 09 14:11:09 devstack sudo[91524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:10 devstack sudo[91524]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f" returned: 0 in 0.750s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:10 devstack sudo[91554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f Jul 09 14:11:10 devstack sudo[91554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:11 devstack sudo[91554]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f" returned: 0 in 0.626s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:11 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-43da6fb6-9c86-4c8d-9d5d-6c9dc232099f" released by "delete_volume" :: held 1.442s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:11:11 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] Created reservations ['93cd2f96-424b-4dda-90a5-2d3f8aabbef7'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:11:11 devstack cinder-volume[87011]: WARNING cinder.db.sqlalchemy.api [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1641990162'] Jul 09 14:11:11 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] Created reservations ['cf7527bf-bb10-438c-8310-5a50c6995a83', '90805dce-423b-4120-88fd-86da3b4dc702', '974dab82-0177-4404-8c6c-74324cad0dc3', '96b5b7bf-7382-416f-81bc-4292a375d353'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:11:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:11:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:11:11 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:11:11 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:11:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:11:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:11 devstack sudo[91565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:11:11 devstack sudo[91565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:11 devstack sudo[91565]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.685s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:11 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:11:11 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-e8ff9c31-a58a-4d7d-b488-5b02ac5b0bcc tempest-GroupSnapshotsTest-1287877168 None] Delete group completed successfully. Jul 09 14:11:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:11:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:11:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:11:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:11:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:11:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:11:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:12 devstack sudo[91585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:11:12 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:12 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-73d76040-91b9-4f1c-a898-95ecb6d7a04b tempest-GroupSnapshotsTest-1287877168 None] Group tempest-GroupSnapshotsTest-Group-438647376: creating Jul 09 14:11:12 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=77,cinder:INSERT=16,cinder:UPDATE=58,cinder:DELETE=5 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:11:12 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-73d76040-91b9-4f1c-a898-95ecb6d7a04b tempest-GroupSnapshotsTest-1287877168 None] Group tempest-GroupSnapshotsTest-Group-438647376: created successfully Jul 09 14:11:12 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-73d76040-91b9-4f1c-a898-95ecb6d7a04b tempest-GroupSnapshotsTest-1287877168 None] Create group completed successfully. Jul 09 14:11:13 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.790s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:11:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:11:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 8 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:11:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Flow 'volume_create_manager' (f97d2d65-c2b5-4bb0-bbf4-1ffb498cbd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e74c7f1-b36b-40f1-b5b2-ba60b2ce5630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=80,cinder:UPDATE=71,cinder:INSERT=12,cinder:DELETE=1 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e74c7f1-b36b-40f1-b5b2-ba60b2ce5630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1878968348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e6209dfa-fcae-4b6b-a68e-539694c8aa5e,host='devstack@QuobyteHD#QuobyteHD',id=efe045ad-99eb-40e3-b73c-caa11dedcf77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c29ab42494868a63d01e0aa798056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:11:14Z,use_quota=True,user_id='8a30500deda44cfc93d273873f80ed7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8e4740f-55e7-4981-a554-23c1ecf59ec8),volume_type_id=d8e4740f-55e7-4981-a554-23c1ecf59ec8)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a47aac5-bcf8-4667-ab53-9778215109c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a47aac5-bcf8-4667-ab53-9778215109c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fcad74-8c0b-4e45-b194-4166927a6d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fcad74-8c0b-4e45-b194-4166927a6d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efe045ad-99eb-40e3-b73c-caa11dedcf77', 'volume_name': 'volume-efe045ad-99eb-40e3-b73c-caa11dedcf77', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6a947c-1e12-4bc2-bc60-633db5438530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6a947c-1e12-4bc2-bc60-633db5438530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40135a0d-8656-4df7-8678-a24564d2580b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:11:14 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Volume efe045ad-99eb-40e3-b73c-caa11dedcf77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efe045ad-99eb-40e3-b73c-caa11dedcf77', 'volume_size': 1} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e6209dfa-fcae-4b6b-a68e-539694c8aa5e,created_at=2026-07-09T12:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1878968348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e6209dfa-fcae-4b6b-a68e-539694c8aa5e,host='devstack@QuobyteHD#QuobyteHD',id=efe045ad-99eb-40e3-b73c-caa11dedcf77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c29ab42494868a63d01e0aa798056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:11:14Z,use_quota=True,user_id='8a30500deda44cfc93d273873f80ed7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8e4740f-55e7-4981-a554-23c1ecf59ec8),volume_type_id=d8e4740f-55e7-4981-a554-23c1ecf59ec8)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Creating volume efe045ad-99eb-40e3-b73c-caa11dedcf77 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:11:14 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:11:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:14 devstack sudo[91599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77 1073741824 Jul 09 14:11:14 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:15 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77 1073741824" returned: 0 in 0.852s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:15 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77 Jul 09 14:11:15 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:15 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77" returned: 0 in 0.727s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:11:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:11:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40135a0d-8656-4df7-8678-a24564d2580b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efe045ad-99eb-40e3-b73c-caa11dedcf77', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:11:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c8f631-1010-4b8b-b761-457a5aa6741d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:11:16 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Volume volume-efe045ad-99eb-40e3-b73c-caa11dedcf77 (efe045ad-99eb-40e3-b73c-caa11dedcf77): created successfully Jul 09 14:11:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c8f631-1010-4b8b-b761-457a5aa6741d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:11:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Flow 'volume_create_manager' (f97d2d65-c2b5-4bb0-bbf4-1ffb498cbd30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:11:16 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c53f927c-a0a8-4c21-8c4b-7ca9ee0275bc tempest-GroupSnapshotsTest-1287877168 None] Created volume successfully. Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Flow 'volume_create_manager' (b1bdde2b-8b61-4f52-ab4e-8b44bee6e7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b1e664-8399-41d6-a412-7c5a13ec6bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b1e664-8399-41d6-a412-7c5a13ec6bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-814597784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e6209dfa-fcae-4b6b-a68e-539694c8aa5e,host='devstack@QuobyteHD#QuobyteHD',id=cd2ff499-0e22-4707-a587-568dd621f2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c29ab42494868a63d01e0aa798056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:11:17Z,use_quota=True,user_id='8a30500deda44cfc93d273873f80ed7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8e4740f-55e7-4981-a554-23c1ecf59ec8),volume_type_id=d8e4740f-55e7-4981-a554-23c1ecf59ec8)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce9fd1f-6402-4393-8f33-ee1a6de4e2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce9fd1f-6402-4393-8f33-ee1a6de4e2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5edf5a-83f2-48af-9eaf-ae130514f798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5edf5a-83f2-48af-9eaf-ae130514f798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd2ff499-0e22-4707-a587-568dd621f2cf', 'volume_name': 'volume-cd2ff499-0e22-4707-a587-568dd621f2cf', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cca87b-15f7-4314-9869-05f2fa488848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cca87b-15f7-4314-9869-05f2fa488848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f1ca79-9fd4-4a7b-b448-1f9f3149f3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:11:17 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Volume cd2ff499-0e22-4707-a587-568dd621f2cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd2ff499-0e22-4707-a587-568dd621f2cf', 'volume_size': 1} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e6209dfa-fcae-4b6b-a68e-539694c8aa5e,created_at=2026-07-09T12:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-814597784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e6209dfa-fcae-4b6b-a68e-539694c8aa5e,host='devstack@QuobyteHD#QuobyteHD',id=cd2ff499-0e22-4707-a587-568dd621f2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c29ab42494868a63d01e0aa798056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:11:17Z,use_quota=True,user_id='8a30500deda44cfc93d273873f80ed7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8e4740f-55e7-4981-a554-23c1ecf59ec8),volume_type_id=d8e4740f-55e7-4981-a554-23c1ecf59ec8)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Creating volume cd2ff499-0e22-4707-a587-568dd621f2cf {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:11:17 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:11:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:17 devstack sudo[91644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf 1073741824 Jul 09 14:11:17 devstack sudo[91644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:18 devstack sudo[91644]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf 1073741824" returned: 0 in 0.982s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:18 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf Jul 09 14:11:18 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:19 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf" returned: 0 in 0.658s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:11:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:11:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f1ca79-9fd4-4a7b-b448-1f9f3149f3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd2ff499-0e22-4707-a587-568dd621f2cf', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:11:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e97928e-37cb-493d-8511-87ee171b2928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:11:19 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Volume volume-cd2ff499-0e22-4707-a587-568dd621f2cf (cd2ff499-0e22-4707-a587-568dd621f2cf): created successfully Jul 09 14:11:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e97928e-37cb-493d-8511-87ee171b2928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:11:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Flow 'volume_create_manager' (b1bdde2b-8b61-4f52-ab4e-8b44bee6e7d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:11:19 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-10ee8880-ebf5-472d-92b7-af50ae97e8b0 tempest-GroupSnapshotsTest-1287877168 None] Created volume successfully. Jul 09 14:11:20 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-46bf1ba9-7ec6-41a6-809c-397e92f26ba9 tempest-GroupSnapshotsTest-1287877168 None] Update group completed successfully. Jul 09 14:11:21 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-bade2397-7aec-4a32-9b18-f819867fbb0c tempest-GroupSnapshotsTest-1287877168 None] Update group completed successfully. Jul 09 14:11:21 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-88d9f6e2-2ae2-4f86-87f0-b53be1f080fc req-0db41e68-cec5-4af2-927c-f10dc896d179 tempest-ServerActionsTestOtherA-1241304218 None] Terminate volume connection completed successfully. Jul 09 14:11:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-88d9f6e2-2ae2-4f86-87f0-b53be1f080fc req-0db41e68-cec5-4af2-927c-f10dc896d179 tempest-ServerActionsTestOtherA-1241304218 None] Deleting attachment 02dd1484-2a81-4dfa-a063-c98aecccfdad. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:11:22 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a5999166-a9f6-4aa6-8fd1-aa8cb40f3fb2 tempest-GroupSnapshotsTest-1287877168 None] Update group completed successfully. Jul 09 14:11:23 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-7d2d95df-fafd-4ff9-943b-803dc4f37e4c tempest-GroupSnapshotsTest-1287877168 None] Update group completed successfully. Jul 09 14:11:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-c6a58765-bf57-4f49-bf2f-7762296fa943 req-5552e32b-7dc3-440b-a6fa-aa14cbe59ad4 tempest-TaggedAttachmentsTest-1303787514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:11:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-c6a58765-bf57-4f49-bf2f-7762296fa943 req-5552e32b-7dc3-440b-a6fa-aa14cbe59ad4 tempest-TaggedAttachmentsTest-1303787514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:11:24 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4c7e69-78e7-4fc1-b854-69472c6c7839]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:11:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-c6a58765-bf57-4f49-bf2f-7762296fa943 req-5552e32b-7dc3-440b-a6fa-aa14cbe59ad4 tempest-TaggedAttachmentsTest-1303787514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:24 devstack sudo[91694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79 Jul 09 14:11:24 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:24 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-c6a58765-bf57-4f49-bf2f-7762296fa943 req-5552e32b-7dc3-440b-a6fa-aa14cbe59ad4 tempest-TaggedAttachmentsTest-1303787514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79" returned: 0 in 0.796s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-c6a58765-bf57-4f49-bf2f-7762296fa943 req-5552e32b-7dc3-440b-a6fa-aa14cbe59ad4 tempest-TaggedAttachmentsTest-1303787514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.812s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:11:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-c6a58765-bf57-4f49-bf2f-7762296fa943 req-5552e32b-7dc3-440b-a6fa-aa14cbe59ad4 tempest-TaggedAttachmentsTest-1303787514 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b69a929f-12b7-4530-a481-a23a29909c56', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:11:25 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-c6a58765-bf57-4f49-bf2f-7762296fa943 req-5552e32b-7dc3-440b-a6fa-aa14cbe59ad4 tempest-TaggedAttachmentsTest-1303787514 None] attachment_update completed successfully. Jul 09 14:11:25 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] GroupSnapshot bbe2ea0d-0085-4498-8d55-0fae7a37b6e1: creating. Jul 09 14:11:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Group snapshot bbe2ea0d-0085-4498-8d55-0fae7a37b6e1: creating. {{(pid=87011) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 14:11:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:11:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:11:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Creating offline snapshot 3de3bcad-7228-4bf3-83c9-2ef3e52c0916 of volume efe045ad-99eb-40e3-b73c-caa11dedcf77 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:11:25 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3ff47d-f579-44c1-9267-b753bd7fdbb4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:11:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:25 devstack sudo[91750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77 Jul 09 14:11:25 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:26 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77" returned: 0 in 0.989s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:26 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916 1G Jul 09 14:11:26 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:27 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916 1G" returned: 0 in 0.844s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe045ad-99eb-40e3-b73c-caa11dedcf77 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:27 devstack sudo[92118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe045ad-99eb-40e3-b73c-caa11dedcf77 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916 Jul 09 14:11:27 devstack sudo[92118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:27 devstack sudo[92118]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe045ad-99eb-40e3-b73c-caa11dedcf77 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916" returned: 0 in 0.779s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:27 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 14:11:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:27 devstack sudo[92126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916 Jul 09 14:11:27 devstack sudo[92126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:28 devstack sudo[92126]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916" returned: 0 in 0.782s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:28 devstack sudo[92130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.info Jul 09 14:11:28 devstack sudo[92130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:29 devstack sudo[92130]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.info" returned: 0 in 0.951s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:29 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 14:11:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:29 devstack sudo[92152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.info Jul 09 14:11:29 devstack sudo[92152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:30 devstack sudo[92152]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.info" returned: 0 in 0.724s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.175s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:11:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:11:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:11:30 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Creating offline snapshot 8d51b21e-ff22-4200-ba8e-4ffef31e98d2 of volume cd2ff499-0e22-4707-a587-568dd621f2cf {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:11:30 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e7952e-9494-494c-b7cd-2d2d790c652c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:11:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:30 devstack sudo[92159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf Jul 09 14:11:30 devstack sudo[92159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:31 devstack sudo[92159]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf" returned: 0 in 0.759s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:31 devstack sudo[92166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2 1G Jul 09 14:11:31 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:31 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-841017d2-8592-4e0c-9751-96ac3b936344 req-00f43067-31fc-430a-89fc-e19b1e50370c tempest-TaggedAttachmentsTest-1303787514 None] Terminate volume connection completed successfully. Jul 09 14:11:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-841017d2-8592-4e0c-9751-96ac3b936344 req-00f43067-31fc-430a-89fc-e19b1e50370c tempest-TaggedAttachmentsTest-1303787514 None] Deleting attachment b69a929f-12b7-4530-a481-a23a29909c56. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:11:32 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2 1G" returned: 0 in 0.956s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd2ff499-0e22-4707-a587-568dd621f2cf -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:32 devstack sudo[92199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd2ff499-0e22-4707-a587-568dd621f2cf -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2 Jul 09 14:11:32 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] Acquiring lock "cinder-c3b95738-60cd-49db-accf-8e639a4de844-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:11:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] Lock "cinder-c3b95738-60cd-49db-accf-8e639a4de844-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:11:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] Acquiring lock "cinder-quobyte-c3b95738-60cd-49db-accf-8e639a4de844" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:11:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] Lock "cinder-quobyte-c3b95738-60cd-49db-accf-8e639a4de844" acquired by "delete_volume" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:11:32 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc952002-693f-4bb0-a814-083fdc7020df]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:11:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c3b95738-60cd-49db-accf-8e639a4de844 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:32 devstack sudo[92201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c3b95738-60cd-49db-accf-8e639a4de844 Jul 09 14:11:32 devstack sudo[92201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:32 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd2ff499-0e22-4707-a587-568dd621f2cf -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2" returned: 0 in 0.726s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:32 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 14:11:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:32 devstack sudo[92207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2 Jul 09 14:11:32 devstack sudo[92207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:33 devstack sudo[92201]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c3b95738-60cd-49db-accf-8e639a4de844" returned: 0 in 0.837s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c3b95738-60cd-49db-accf-8e639a4de844 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:33 devstack sudo[92222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c3b95738-60cd-49db-accf-8e639a4de844 Jul 09 14:11:33 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2" returned: 0 in 1.088s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:34 devstack sudo[92207]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:34 devstack sudo[92261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.info Jul 09 14:11:34 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:34 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c3b95738-60cd-49db-accf-8e639a4de844" returned: 0 in 1.055s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] Lock "cinder-quobyte-c3b95738-60cd-49db-accf-8e639a4de844" released by "delete_volume" :: held 1.937s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:11:34 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] Created reservations ['c83d5a68-7baa-49f3-9747-d4000ac9511e', '621d9da9-bb67-405d-b4c4-2cc4932efa24', 'd9153ed2-1c52-4e9b-a529-bc8a7f62886d', 'b4f4efad-754b-4f62-9fb8-e6522222ae30'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:11:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:11:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:11:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:11:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:11:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:11:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:34 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:11:34 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:35 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.info" returned: 0 in 0.917s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:35 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 14:11:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:35 devstack sudo[92295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.info Jul 09 14:11:35 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:35 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.149s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:35 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:11:35 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] Deleted volume successfully. Jul 09 14:11:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b7ced8d2-abbf-49e9-aed6-eb5833c11e0e tempest-ServerActionsTestOtherA-1241304218 None] Lock "cinder-c3b95738-60cd-49db-accf-8e639a4de844-delete_volume" released by "delete_volume" :: held 3.377s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:11:36 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.info" returned: 0 in 0.999s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.565s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:11:36 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-6c012e30-7f3d-4a6a-b9fa-bec279b05d8e tempest-GroupSnapshotsTest-1287877168 None] group_snapshot bbe2ea0d-0085-4498-8d55-0fae7a37b6e1: created successfully Jul 09 14:11:37 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] group_snapshot bbe2ea0d-0085-4498-8d55-0fae7a37b6e1: deleting Jul 09 14:11:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] group_snapshot bbe2ea0d-0085-4498-8d55-0fae7a37b6e1: deleting {{(pid=87011) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 14:11:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "cinder-quobyte-efe045ad-99eb-40e3-b73c-caa11dedcf77" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:11:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-efe045ad-99eb-40e3-b73c-caa11dedcf77" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:11:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "cinder-quobyte-3de3bcad-7228-4bf3-83c9-2ef3e52c0916" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:11:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-3de3bcad-7228-4bf3-83c9-2ef3e52c0916" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:11:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Deleting offline snapshot 3de3bcad-7228-4bf3-83c9-2ef3e52c0916 of volume efe045ad-99eb-40e3-b73c-caa11dedcf77 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:11:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] snapshot_file for this snap is: volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:11:37 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4510e5-f549-4666-b8c7-196e195744bc]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:11:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:37 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916 Jul 09 14:11:37 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:39 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916" returned: 0 in 1.452s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efe045ad-99eb-40e3-b73c-caa11dedcf77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:11:39 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57eb40d-e4fa-438c-b0d5-28794f857bfd]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:11:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:39 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77 Jul 09 14:11:39 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:40 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77" returned: 0 in 0.952s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:40 devstack sudo[92354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916 Jul 09 14:11:40 devstack sudo[92354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:40 devstack sudo[92354]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916" returned: 0 in 0.886s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:40 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916 Jul 09 14:11:40 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:41 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77.3de3bcad-7228-4bf3-83c9-2ef3e52c0916" returned: 0 in 0.902s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:41 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-3de3bcad-7228-4bf3-83c9-2ef3e52c0916" released by "_delete_snapshot" :: held 4.353s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:11:41 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-efe045ad-99eb-40e3-b73c-caa11dedcf77" released by "delete_snapshot" :: held 4.393s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:11:41 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "cinder-quobyte-cd2ff499-0e22-4707-a587-568dd621f2cf" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:11:41 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-cd2ff499-0e22-4707-a587-568dd621f2cf" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:11:41 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "cinder-quobyte-8d51b21e-ff22-4200-ba8e-4ffef31e98d2" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:11:41 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-8d51b21e-ff22-4200-ba8e-4ffef31e98d2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:11:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Deleting offline snapshot 8d51b21e-ff22-4200-ba8e-4ffef31e98d2 of volume cd2ff499-0e22-4707-a587-568dd621f2cf {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:11:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] snapshot_file for this snap is: volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:11:42 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65665a6-7f2e-4c2c-af51-193da3486896]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:11:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:42 devstack sudo[92366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2 Jul 09 14:11:42 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:42 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2" returned: 0 in 0.882s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd2ff499-0e22-4707-a587-568dd621f2cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:11:43 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b355e8-7345-477f-883b-f02697cf2b84]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:11:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:43 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf Jul 09 14:11:43 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:44 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf" returned: 0 in 1.101s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:44 devstack sudo[92401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2 Jul 09 14:11:44 devstack sudo[92401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:45 devstack sudo[92401]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2" returned: 0 in 1.043s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:45 devstack sudo[92410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2 Jul 09 14:11:45 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:45 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf.8d51b21e-ff22-4200-ba8e-4ffef31e98d2" returned: 0 in 0.729s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:45 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-8d51b21e-ff22-4200-ba8e-4ffef31e98d2" released by "_delete_snapshot" :: held 3.966s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:11:45 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-cd2ff499-0e22-4707-a587-568dd621f2cf" released by "delete_snapshot" :: held 3.993s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:11:46 devstack cinder-volume[87011]: WARNING cinder.quota [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1747236178 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1747236178, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:11:46 devstack cinder-volume[87011]: WARNING cinder.quota [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1747236178 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1747236178, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:11:46 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Created reservations ['13685642-672c-4e03-88cb-a1dbb40e389d', '978dd839-b413-4322-aa46-a23331a033d6', 'ceb1d870-ae3d-48ca-b263-4459edfcfe23', 'd4050796-ea16-469c-9e7f-ff090ba4371b'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:11:46 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] Created reservations ['ec1813f2-c105-4c57-9ff3-de7915a90331', '0143b038-a17a-4bf0-af27-a934515c1c70', '1e5b3dbb-bb8f-40a6-a6cd-cac79d7fdf03', '519c8944-ff02-48e2-b03d-f8e8e8e592f7'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:11:46 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-bf151894-2b7f-4c4f-8948-8ef6cfb56c9f tempest-GroupSnapshotsTest-1287877168 None] group_snapshot bbe2ea0d-0085-4498-8d55-0fae7a37b6e1: deleted successfully Jul 09 14:11:46 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "cinder-quobyte-cd2ff499-0e22-4707-a587-568dd621f2cf" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:11:46 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-cd2ff499-0e22-4707-a587-568dd621f2cf" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:11:46 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e59a3de-9e0e-4d84-973f-ae4b53397f4b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:11:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:47 devstack sudo[92414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf Jul 09 14:11:47 devstack sudo[92414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:47 devstack sudo[92414]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf" returned: 0 in 0.875s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:47 devstack sudo[92420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf Jul 09 14:11:47 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cd2ff499-0e22-4707-a587-568dd621f2cf" returned: 0 in 1.059s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:48 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-cd2ff499-0e22-4707-a587-568dd621f2cf" released by "delete_volume" :: held 2.044s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:11:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "cinder-quobyte-efe045ad-99eb-40e3-b73c-caa11dedcf77" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:11:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-efe045ad-99eb-40e3-b73c-caa11dedcf77" acquired by "delete_volume" :: waited 0.039s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:11:49 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[231ada6c-067a-491a-b0cb-7bc663147263]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:11:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:49 devstack sudo[92441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77 Jul 09 14:11:49 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:50 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77" returned: 0 in 0.919s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:50 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77 Jul 09 14:11:50 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:50 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-efe045ad-99eb-40e3-b73c-caa11dedcf77" returned: 0 in 0.799s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:50 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-efe045ad-99eb-40e3-b73c-caa11dedcf77" released by "delete_volume" :: held 1.820s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:11:50 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Created reservations ['af04cb3a-c9d7-415a-9262-d79aceb5b2aa'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:11:50 devstack cinder-volume[87011]: WARNING cinder.quota [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1747236178 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1747236178, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:11:50 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Created reservations ['feec39c0-6f90-45f2-a969-b0fb94a769ee', '3e665c2d-4136-4f9e-9150-8ea1d5e633a1', '1f3bd9b1-23b6-4d0a-8740-29108637c7a7', '81fdb463-373e-4648-beee-a89374cf4cfe'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:11:51 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Created reservations ['269f99b5-98e9-4c2e-b119-873e8be53e65', 'aed38cf2-da68-4c7e-842b-102b9e563fdb', '44518283-e7e8-4f8f-b26c-c27fe342d45e', '96e9cbd2-39f9-443e-a422-c0f8099646b1'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:11:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] Acquiring lock "cinder-57cf729c-0006-4cfc-a1d7-cc8295c3fd79-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:11:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:11:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:11:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:11:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:11:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:11:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] Lock "cinder-57cf729c-0006-4cfc-a1d7-cc8295c3fd79-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:11:51 devstack sudo[92460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:11:51 devstack sudo[92460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] Acquiring lock "cinder-quobyte-57cf729c-0006-4cfc-a1d7-cc8295c3fd79" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:11:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] Lock "cinder-quobyte-57cf729c-0006-4cfc-a1d7-cc8295c3fd79" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:11:51 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[887f7e6a-efcd-4723-bc6d-fc3e1506f61b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:11:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:51 devstack sudo[92462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79 Jul 09 14:11:51 devstack sudo[92462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:52 devstack sudo[92460]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.729s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:52 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:11:52 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-1c46aef5-cce6-45ef-8354-677a1a59b362 tempest-GroupSnapshotsTest-1287877168 None] Delete group completed successfully. Jul 09 14:11:52 devstack sudo[92462]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79" returned: 0 in 0.832s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:52 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79 Jul 09 14:11:52 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:52 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-4b7275d7-ffa2-43ad-898d-91821aa8e73a tempest-GroupSnapshotsTest-1287877168 None] Group tempest-GroupSnapshotsTest-Group-423115620: creating Jul 09 14:11:52 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-4b7275d7-ffa2-43ad-898d-91821aa8e73a tempest-GroupSnapshotsTest-1287877168 None] Group tempest-GroupSnapshotsTest-Group-423115620: created successfully Jul 09 14:11:52 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-4b7275d7-ffa2-43ad-898d-91821aa8e73a tempest-GroupSnapshotsTest-1287877168 None] Create group completed successfully. Jul 09 14:11:53 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-57cf729c-0006-4cfc-a1d7-cc8295c3fd79" returned: 0 in 0.730s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] Lock "cinder-quobyte-57cf729c-0006-4cfc-a1d7-cc8295c3fd79" released by "delete_volume" :: held 1.613s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:11:53 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] Created reservations ['a19597a8-33c5-47bd-ae9c-0ebacddee7c0', '13805050-8480-438e-85eb-0122ae5f22fa', 'f37af1de-6ff9-416f-a0c1-dd38f4b48e92', '2bf3f96c-aa87-4462-a399-0847401f2de9'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:11:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:11:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:11:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:11:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:11:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:11:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:53 devstack sudo[92471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:11:53 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:53 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.804s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:53 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:11:53 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] Deleted volume successfully. Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cc184848-a845-41e6-b9b8-b297c17644af tempest-TaggedAttachmentsTest-1303787514 None] Lock "cinder-57cf729c-0006-4cfc-a1d7-cc8295c3fd79-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Flow 'volume_create_manager' (1c4d53e5-db92-451d-b1c0-79664dfaec43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0e8b07-0c95-4b76-be35-049a7033f8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad0e8b07-0c95-4b76-be35-049a7033f8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1614254577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5203d281-4eed-4b41-9e4d-f92467a8a1d1,host='devstack@QuobyteHD#QuobyteHD',id=77a8c953-1aef-4d16-9ec5-d9c95814389c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c29ab42494868a63d01e0aa798056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:11:54Z,use_quota=True,user_id='8a30500deda44cfc93d273873f80ed7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a60ff430-20d4-4c4b-9750-71dc6d6bcdcd),volume_type_id=a60ff430-20d4-4c4b-9750-71dc6d6bcdcd)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572e7b5f-2507-40e7-add8-874716399b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572e7b5f-2507-40e7-add8-874716399b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4321d06c-705e-4b58-9a90-dee7c15b93d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4321d06c-705e-4b58-9a90-dee7c15b93d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77a8c953-1aef-4d16-9ec5-d9c95814389c', 'volume_name': 'volume-77a8c953-1aef-4d16-9ec5-d9c95814389c', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2eded5c-6fd4-4b70-9dbd-3d6c3f190cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2eded5c-6fd4-4b70-9dbd-3d6c3f190cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4786b4c1-53d4-4b1d-99f7-2f82109d2a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:11:54 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Volume 77a8c953-1aef-4d16-9ec5-d9c95814389c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77a8c953-1aef-4d16-9ec5-d9c95814389c', 'volume_size': 1} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5203d281-4eed-4b41-9e4d-f92467a8a1d1,created_at=2026-07-09T12:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1614254577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5203d281-4eed-4b41-9e4d-f92467a8a1d1,host='devstack@QuobyteHD#QuobyteHD',id=77a8c953-1aef-4d16-9ec5-d9c95814389c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='112c29ab42494868a63d01e0aa798056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:11:54Z,use_quota=True,user_id='8a30500deda44cfc93d273873f80ed7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a60ff430-20d4-4c4b-9750-71dc6d6bcdcd),volume_type_id=a60ff430-20d4-4c4b-9750-71dc6d6bcdcd)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Creating volume 77a8c953-1aef-4d16-9ec5-d9c95814389c {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:11:54 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:11:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:54 devstack sudo[92474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c 1073741824 Jul 09 14:11:54 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:55 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c 1073741824" returned: 0 in 1.195s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:55 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c Jul 09 14:11:55 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:56 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c" returned: 0 in 0.678s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:11:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:11:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4786b4c1-53d4-4b1d-99f7-2f82109d2a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a8c953-1aef-4d16-9ec5-d9c95814389c', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:11:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca70b69-ce64-4637-8812-c74d87db7b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:11:56 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Volume volume-77a8c953-1aef-4d16-9ec5-d9c95814389c (77a8c953-1aef-4d16-9ec5-d9c95814389c): created successfully Jul 09 14:11:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca70b69-ce64-4637-8812-c74d87db7b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:11:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Flow 'volume_create_manager' (1c4d53e5-db92-451d-b1c0-79664dfaec43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:11:56 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-50c1e082-8f40-4256-99c7-07fda2996183 tempest-GroupSnapshotsTest-1287877168 None] Created volume successfully. Jul 09 14:11:56 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] GroupSnapshot 5120d437-09d9-454b-8891-b8d59dd2faa1: creating. Jul 09 14:11:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] Group snapshot 5120d437-09d9-454b-8891-b8d59dd2faa1: creating. {{(pid=87011) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 14:11:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:11:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:11:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] Creating offline snapshot a6fe10fc-690b-453b-8013-2ea4cb36514a of volume 77a8c953-1aef-4d16-9ec5-d9c95814389c {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:11:57 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[7130ab81-bc33-46ab-bcd3-57c46390f5b5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:11:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:57 devstack sudo[92520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c Jul 09 14:11:57 devstack sudo[92520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:58 devstack sudo[92520]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c" returned: 0 in 1.162s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:58 devstack sudo[92526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a 1G Jul 09 14:11:58 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:11:59 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root Jul 09 14:11:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a 1G" returned: 0 in 1.070s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:11:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a8c953-1aef-4d16-9ec5-d9c95814389c -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:11:59 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a8c953-1aef-4d16-9ec5-d9c95814389c -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a Jul 09 14:11:59 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:00 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77a8c953-1aef-4d16-9ec5-d9c95814389c -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a" returned: 0 in 0.765s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:00 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a is being set with open permissions: ugo+rw: NotImplementedError Jul 09 14:12:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:00 devstack sudo[92541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a Jul 09 14:12:00 devstack sudo[92541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:00 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:12:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Flow 'volume_create_manager' (af2a9377-6f3e-4026-8861-9ad3bae26935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:12:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf476829-14a2-4cc9-9a60-1133f1e1913e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf476829-14a2-4cc9-9a60-1133f1e1913e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-589414502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdd2245-6185-4300-9c20-09c246435d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9986ea392cb94b35b696c956d33f27f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:12:01Z,use_quota=True,user_id='738381f58f9647b2b55e7283075b7bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f99c20-ce43-4f44-bd0e-9a79c94a431b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f99c20-ce43-4f44-bd0e-9a79c94a431b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d62625-f9e1-4de6-b7d3-e6eed1c58663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d62625-f9e1-4de6-b7d3-e6eed1c58663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcdd2245-6185-4300-9c20-09c246435d3f', 'volume_name': 'volume-bcdd2245-6185-4300-9c20-09c246435d3f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b09287-762f-441c-84c3-3cf62dbf486d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b09287-762f-441c-84c3-3cf62dbf486d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d502440-a64a-4733-9e5d-523d9eae1351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:00 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Volume bcdd2245-6185-4300-9c20-09c246435d3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcdd2245-6185-4300-9c20-09c246435d3f', 'volume_size': 1} Jul 09 14:12:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:12:00 devstack sudo[92541]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a" returned: 0 in 0.855s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:01 devstack sudo[92545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.info Jul 09 14:12:01 devstack sudo[92545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:01 devstack sudo[92545]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.info" returned: 0 in 0.820s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:01 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 14:12:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:01 devstack sudo[92548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.info Jul 09 14:12:01 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:02 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.info" returned: 0 in 0.786s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.623s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:12:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.783s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:12:02 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-589414502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdd2245-6185-4300-9c20-09c246435d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9986ea392cb94b35b696c956d33f27f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:12:01Z,use_quota=True,user_id='738381f58f9647b2b55e7283075b7bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:12:02 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Creating volume bcdd2245-6185-4300-9c20-09c246435d3f {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:12:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:12:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:12:02 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:12:02 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:12:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:12:02 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:12:02 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:12:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bcdd2245-6185-4300-9c20-09c246435d3f 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:02 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bcdd2245-6185-4300-9c20-09c246435d3f 1073741824 Jul 09 14:12:02 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:02 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-2fa40e14-52bf-414a-b520-4fdbd24d62f2 tempest-GroupSnapshotsTest-1287877168 None] group_snapshot 5120d437-09d9-454b-8891-b8d59dd2faa1: created successfully Jul 09 14:12:03 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] group_snapshot 5120d437-09d9-454b-8891-b8d59dd2faa1: deleting Jul 09 14:12:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] group_snapshot 5120d437-09d9-454b-8891-b8d59dd2faa1: deleting {{(pid=87011) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 14:12:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "cinder-quobyte-77a8c953-1aef-4d16-9ec5-d9c95814389c" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:12:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-77a8c953-1aef-4d16-9ec5-d9c95814389c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:12:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "cinder-quobyte-a6fe10fc-690b-453b-8013-2ea4cb36514a" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:12:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-a6fe10fc-690b-453b-8013-2ea4cb36514a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:12:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] Deleting offline snapshot a6fe10fc-690b-453b-8013-2ea4cb36514a of volume 77a8c953-1aef-4d16-9ec5-d9c95814389c {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:12:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] snapshot_file for this snap is: volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:12:03 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a929194-a951-4bcb-98a4-1545b6e13d50]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:12:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:03 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bcdd2245-6185-4300-9c20-09c246435d3f 1073741824" returned: 0 in 1.334s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:03 devstack sudo[92560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a Jul 09 14:12:03 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bcdd2245-6185-4300-9c20-09c246435d3f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:04 devstack sudo[92562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bcdd2245-6185-4300-9c20-09c246435d3f Jul 09 14:12:04 devstack sudo[92562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:04 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a" returned: 0 in 1.090s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77a8c953-1aef-4d16-9ec5-d9c95814389c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:12:04 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffe565e-e13e-4284-ba7e-a54400dd3c8a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:12:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:05 devstack sudo[92562]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bcdd2245-6185-4300-9c20-09c246435d3f" returned: 0 in 0.992s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] <== create_volume: return (2388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:12:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.394s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:12:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d502440-a64a-4733-9e5d-523d9eae1351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcdd2245-6185-4300-9c20-09c246435d3f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27785203-ac5a-4e8d-b678-00a8a6221895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:05 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Volume volume-bcdd2245-6185-4300-9c20-09c246435d3f (bcdd2245-6185-4300-9c20-09c246435d3f): created successfully Jul 09 14:12:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27785203-ac5a-4e8d-b678-00a8a6221895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Flow 'volume_create_manager' (af2a9377-6f3e-4026-8861-9ad3bae26935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:12:05 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-866be9e5-a37e-40ac-860f-296da62d645d tempest-AttachVolumeNegativeTest-335382434 None] Created volume successfully. Jul 09 14:12:05 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c Jul 09 14:12:05 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:05 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c" returned: 0 in 0.905s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:05 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a Jul 09 14:12:05 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:06 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a" returned: 0 in 0.811s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:06 devstack sudo[92588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a Jul 09 14:12:06 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:07 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c.a6fe10fc-690b-453b-8013-2ea4cb36514a" returned: 0 in 0.689s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-a6fe10fc-690b-453b-8013-2ea4cb36514a" released by "_delete_snapshot" :: held 3.646s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:12:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-77a8c953-1aef-4d16-9ec5-d9c95814389c" released by "delete_snapshot" :: held 3.675s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:12:07 devstack cinder-volume[87011]: WARNING cinder.quota [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1625843479 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1625843479, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:12:07 devstack cinder-volume[87011]: WARNING cinder.quota [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1625843479 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1625843479, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:12:07 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] Created reservations ['e94990fd-9c24-4099-856a-38730cd67959', '5aaf04dd-9270-4bb8-8671-274900d55f10', '7a2de294-11b6-4ae9-a364-f33daee1421d', '2d24781b-1b49-400c-a48d-20c87f33e737'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:12:07 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-36d3f663-7cac-4422-87e7-50f170055166 tempest-GroupSnapshotsTest-1287877168 None] group_snapshot 5120d437-09d9-454b-8891-b8d59dd2faa1: deleted successfully Jul 09 14:12:08 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "cinder-quobyte-77a8c953-1aef-4d16-9ec5-d9c95814389c" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:12:08 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-77a8c953-1aef-4d16-9ec5-d9c95814389c" acquired by "delete_volume" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:12:08 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f609dac-f496-48d4-85bb-235101f4f872]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:12:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:08 devstack sudo[92592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c Jul 09 14:12:08 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-8923329b-85da-4526-9e1e-25963525d08e req-e9e1fa1d-c65c-4407-9b19-ec8872c0ae14 tempest-AttachVolumeNegativeTest-335382434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:12:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-8923329b-85da-4526-9e1e-25963525d08e req-e9e1fa1d-c65c-4407-9b19-ec8872c0ae14 tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:12:09 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71078a9-11b5-4ed7-81c7-36493f28420f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:12:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-8923329b-85da-4526-9e1e-25963525d08e req-e9e1fa1d-c65c-4407-9b19-ec8872c0ae14 tempest-AttachVolumeNegativeTest-335382434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bcdd2245-6185-4300-9c20-09c246435d3f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:09 devstack sudo[92602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bcdd2245-6185-4300-9c20-09c246435d3f Jul 09 14:12:09 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:09 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c" returned: 0 in 0.921s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:09 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c Jul 09 14:12:09 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:10 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-8923329b-85da-4526-9e1e-25963525d08e req-e9e1fa1d-c65c-4407-9b19-ec8872c0ae14 tempest-AttachVolumeNegativeTest-335382434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bcdd2245-6185-4300-9c20-09c246435d3f" returned: 0 in 0.931s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-8923329b-85da-4526-9e1e-25963525d08e req-e9e1fa1d-c65c-4407-9b19-ec8872c0ae14 tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.964s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:12:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-8923329b-85da-4526-9e1e-25963525d08e req-e9e1fa1d-c65c-4407-9b19-ec8872c0ae14 tempest-AttachVolumeNegativeTest-335382434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-bcdd2245-6185-4300-9c20-09c246435d3f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82c6432b-c0c8-4056-b03e-a0bfa2327413', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:12:10 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-8923329b-85da-4526-9e1e-25963525d08e req-e9e1fa1d-c65c-4407-9b19-ec8872c0ae14 tempest-AttachVolumeNegativeTest-335382434 None] attachment_update completed successfully. Jul 09 14:12:10 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-77a8c953-1aef-4d16-9ec5-d9c95814389c" returned: 0 in 0.837s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] Lock "cinder-quobyte-77a8c953-1aef-4d16-9ec5-d9c95814389c" released by "delete_volume" :: held 1.829s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:12:10 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] Created reservations ['e51f3ce6-1cbb-46f7-bb47-22062d2ea278'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:12:10 devstack cinder-volume[87011]: WARNING cinder.quota [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1625843479 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1625843479, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:12:10 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] Created reservations ['b3ebf54b-e324-4397-8cbe-305b4a4ded36', '307a32cd-4fe7-4a71-bac4-5a3f5ee93faa', '5adf7433-7671-465a-badc-873dc4fabd43', 'a2f6f08d-a7ba-47e8-b655-b0c643f85c4d'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:12:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:12:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:12:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:12:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:12:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:12:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:10 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:12:10 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:11 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.862s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:11 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:12:11 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-af80e55a-a980-4848-8a17-5d451d120be7 tempest-GroupSnapshotsTest-1287877168 None] Delete group completed successfully. Jul 09 14:12:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:12:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:12:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:12:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:12:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:12:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:12:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:12 devstack sudo[93014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:12:12 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:13 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.871s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:12:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:12:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 8 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:12:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:12:18 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=89,cinder:SELECT=90,cinder:INSERT=21,cinder:DELETE=1 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:12:18 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=100,cinder:UPDATE=90,cinder:INSERT=20,cinder:DELETE=5 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:12:18 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-8133dcbb-e108-4392-b434-e910deb97eec req-5919826d-72aa-4565-947c-95d314586392 tempest-AttachVolumeNegativeTest-335382434 None] Terminate volume connection completed successfully. Jul 09 14:12:18 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-8133dcbb-e108-4392-b434-e910deb97eec req-5919826d-72aa-4565-947c-95d314586392 tempest-AttachVolumeNegativeTest-335382434 None] Deleting attachment 82c6432b-c0c8-4056-b03e-a0bfa2327413. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:12:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] Acquiring lock "cinder-bcdd2245-6185-4300-9c20-09c246435d3f-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:12:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] Lock "cinder-bcdd2245-6185-4300-9c20-09c246435d3f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:12:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] Acquiring lock "cinder-quobyte-bcdd2245-6185-4300-9c20-09c246435d3f" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:12:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] Lock "cinder-quobyte-bcdd2245-6185-4300-9c20-09c246435d3f" acquired by "delete_volume" :: waited 0.026s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:12:30 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3658479-25a5-4c55-aef3-2480d289f206]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:12:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bcdd2245-6185-4300-9c20-09c246435d3f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:30 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bcdd2245-6185-4300-9c20-09c246435d3f Jul 09 14:12:30 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:31 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bcdd2245-6185-4300-9c20-09c246435d3f" returned: 0 in 1.235s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bcdd2245-6185-4300-9c20-09c246435d3f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:31 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bcdd2245-6185-4300-9c20-09c246435d3f Jul 09 14:12:31 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:32 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bcdd2245-6185-4300-9c20-09c246435d3f" returned: 0 in 1.157s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] Lock "cinder-quobyte-bcdd2245-6185-4300-9c20-09c246435d3f" released by "delete_volume" :: held 2.490s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:12:32 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] Created reservations ['814085f4-7d18-4cfc-a0f0-50f3c1a19571', 'fb405304-11b3-4dc1-b75d-1f9263bc40fc', '444b5628-dfec-4094-ab93-1696cc9c32ab', '618e231f-d7f8-467e-acf5-f91e507ec3cf'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:12:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:12:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:12:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:12:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:12:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:12:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:32 devstack sudo[93204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:12:32 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:33 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.920s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:33 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:12:33 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] Deleted volume successfully. Jul 09 14:12:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-37daa6a0-8fd2-4f54-b9c5-7fd6ee5d65f8 tempest-AttachVolumeNegativeTest-335382434 None] Lock "cinder-bcdd2245-6185-4300-9c20-09c246435d3f-delete_volume" released by "delete_volume" :: held 3.809s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:12:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] Acquiring lock "cinder-874af085-b658-4437-a67a-aeef6d095e34-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:12:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] Lock "cinder-874af085-b658-4437-a67a-aeef6d095e34-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:12:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] Acquiring lock "cinder-quobyte-874af085-b658-4437-a67a-aeef6d095e34" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:12:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] Lock "cinder-quobyte-874af085-b658-4437-a67a-aeef6d095e34" acquired by "delete_volume" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:12:34 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a608be-204f-480a-a99a-b9d7e5b38ed3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:12:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-874af085-b658-4437-a67a-aeef6d095e34 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:34 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-874af085-b658-4437-a67a-aeef6d095e34 Jul 09 14:12:34 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:35 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-874af085-b658-4437-a67a-aeef6d095e34" returned: 0 in 1.149s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-874af085-b658-4437-a67a-aeef6d095e34 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:35 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-874af085-b658-4437-a67a-aeef6d095e34 Jul 09 14:12:35 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:36 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-874af085-b658-4437-a67a-aeef6d095e34" returned: 0 in 0.937s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] Lock "cinder-quobyte-874af085-b658-4437-a67a-aeef6d095e34" released by "delete_volume" :: held 2.151s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:12:36 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] Created reservations ['fdc404ec-220f-466c-9db6-13cdda366502', '206a7a04-11c1-41e4-a04b-2b23403c2645', '1b6d5d1d-ff10-4fca-a981-23b20c8a0022', 'c5ea58d8-2f84-4685-a1d5-deaf2c9848bb'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:12:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:12:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:12:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:12:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:12:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:12:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:36 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:12:36 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:37 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.782s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:37 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:12:37 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] Deleted volume successfully. Jul 09 14:12:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-38857232-01ae-4952-a515-7dfebdf06dee tempest-AttachVolumeNegativeTest-335382434 None] Lock "cinder-874af085-b658-4437-a67a-aeef6d095e34-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:12:38 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] Acquiring lock "cinder-e738c6ce-2c4d-4e7c-a3a5-83263e33389b-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:12:38 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] Lock "cinder-e738c6ce-2c4d-4e7c-a3a5-83263e33389b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:12:38 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] Acquiring lock "cinder-quobyte-e738c6ce-2c4d-4e7c-a3a5-83263e33389b" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:12:38 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] Lock "cinder-quobyte-e738c6ce-2c4d-4e7c-a3a5-83263e33389b" acquired by "delete_volume" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:12:38 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[88588590-ed74-424a-a1aa-02680b0b5af2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:12:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:38 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b Jul 09 14:12:38 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:39 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b" returned: 0 in 1.390s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:39 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b Jul 09 14:12:39 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:40 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e738c6ce-2c4d-4e7c-a3a5-83263e33389b" returned: 0 in 0.779s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] Lock "cinder-quobyte-e738c6ce-2c4d-4e7c-a3a5-83263e33389b" released by "delete_volume" :: held 2.211s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:12:40 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] Created reservations ['b018e6fc-0663-4736-9a85-f22280263f01', '47640ea3-a3ba-497b-bb90-e9ffe3b2cd8c', '538c4605-5d84-4cf3-8924-7832f26f06af', 'c4cee9d0-fe89-4be6-a910-a3f3633b5087'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:12:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:12:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:12:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:12:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:12:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:12:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:40 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:12:40 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Flow 'volume_create_manager' (c3fe08f6-9425-4ddf-bb98-c1ff7dd40ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb14c3e-fc3b-4f67-94a9-7dfb85254bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb14c3e-fc3b-4f67-94a9-7dfb85254bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-282527013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ff28aa1757490b8767ea9bf6ef289a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:12:41Z,use_quota=True,user_id='5a758e4423534d649ce8e43088a05822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59729719-1b27-41a6-be2a-7ab557c44208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59729719-1b27-41a6-be2a-7ab557c44208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b0ccfc-cd29-4423-aca4-1982ac1acbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54b0ccfc-cd29-4423-aca4-1982ac1acbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481', 'volume_name': 'volume-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b818b5-fa76-4da3-94d0-d228b560eecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b818b5-fa76-4da3-94d0-d228b560eecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0671991-d04e-4ec8-9cfa-3353c2f2e239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:41 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Volume 90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481', 'volume_size': 1} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-282527013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ff28aa1757490b8767ea9bf6ef289a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:12:41Z,use_quota=True,user_id='5a758e4423534d649ce8e43088a05822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Creating volume 90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:12:41 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:12:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:41 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481 1073741824 Jul 09 14:12:41 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:42 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.358s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:42 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:12:42 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] Deleted volume successfully. Jul 09 14:12:42 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-10822307-87a3-48d3-a020-df6c46e8b806 tempest-AttachVolumeNegativeTest-335382434 None] Lock "cinder-e738c6ce-2c4d-4e7c-a3a5-83263e33389b-delete_volume" released by "delete_volume" :: held 3.898s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:12:43 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481 1073741824" returned: 0 in 1.998s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:43 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481 Jul 09 14:12:43 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:45 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481" returned: 0 in 1.414s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] <== create_volume: return (3599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:12:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.606s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:12:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0671991-d04e-4ec8-9cfa-3353c2f2e239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd6316de-888e-4158-9f0a-64b6ca584b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:45 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Volume volume-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481 (90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481): created successfully Jul 09 14:12:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd6316de-888e-4158-9f0a-64b6ca584b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Flow 'volume_create_manager' (c3fe08f6-9425-4ddf-bb98-c1ff7dd40ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:12:45 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-8918c9a1-0ab2-43a6-ac79-b5632d8caac6 tempest-VolumeQuotasAdminTestJSON-189648551 None] Created volume successfully. Jul 09 14:12:46 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] Acquiring lock "cinder-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:12:46 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] Lock "cinder-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:12:46 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] Acquiring lock "cinder-quobyte-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:12:46 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] Lock "cinder-quobyte-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481" acquired by "delete_volume" :: waited 0.033s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:12:46 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[b874751f-7e8d-4643-817d-63147a60d8ac]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:12:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:46 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481 Jul 09 14:12:46 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:48 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481" returned: 0 in 2.017s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:48 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481 Jul 09 14:12:48 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:49 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481" returned: 0 in 1.579s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] Lock "cinder-quobyte-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481" released by "delete_volume" :: held 3.759s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:12:50 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] Created reservations ['b8f186f8-4291-4181-a4e6-b0093ad39fef', 'ebdc757a-04f3-46d0-a210-2c16377cf14a', 'f57229be-bb98-4262-a69d-e127be51d214', '28147abf-86c7-42d9-8fde-fdbfefff2b5b'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:12:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:12:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:12:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:12:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:12:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:12:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:50 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:12:50 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:52 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 2.015s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:52 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:12:52 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] Deleted volume successfully. Jul 09 14:12:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b5aa81e3-fae8-4c0e-922c-5d0a76617920 tempest-VolumeQuotasAdminTestJSON-189648551 None] Lock "cinder-90ac1582-dad8-4bb5-a0ad-eb2d9c2ed481-delete_volume" released by "delete_volume" :: held 6.405s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:12:52 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Flow 'volume_create_manager' (e4c17af1-45e3-49ab-9be7-6fbfb6d01e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625880f3-b55a-4f69-b29b-6dee30341722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625880f3-b55a-4f69-b29b-6dee30341722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-611980910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7072da54-de69-4fe5-a7c4-77028f86b532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ff28aa1757490b8767ea9bf6ef289a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:12:53Z,use_quota=True,user_id='5a758e4423534d649ce8e43088a05822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16bdda1-ba44-478f-9fd7-12ef8f92a5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16bdda1-ba44-478f-9fd7-12ef8f92a5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f10ff84-4e80-46b7-b15a-471a6b23afb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f10ff84-4e80-46b7-b15a-471a6b23afb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7072da54-de69-4fe5-a7c4-77028f86b532', 'volume_name': 'volume-7072da54-de69-4fe5-a7c4-77028f86b532', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb10bce8-6da0-4639-a448-2799a5899227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb10bce8-6da0-4639-a448-2799a5899227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4fe28b-9c87-4a02-b04f-e8ca48d67260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:53 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Volume 7072da54-de69-4fe5-a7c4-77028f86b532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7072da54-de69-4fe5-a7c4-77028f86b532', 'volume_size': 1} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-611980910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7072da54-de69-4fe5-a7c4-77028f86b532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ff28aa1757490b8767ea9bf6ef289a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:12:53Z,use_quota=True,user_id='5a758e4423534d649ce8e43088a05822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Creating volume 7072da54-de69-4fe5-a7c4-77028f86b532 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:12:53 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:12:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7072da54-de69-4fe5-a7c4-77028f86b532 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:53 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7072da54-de69-4fe5-a7c4-77028f86b532 1073741824 Jul 09 14:12:53 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:55 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7072da54-de69-4fe5-a7c4-77028f86b532 1073741824" returned: 0 in 2.138s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7072da54-de69-4fe5-a7c4-77028f86b532 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:55 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7072da54-de69-4fe5-a7c4-77028f86b532 Jul 09 14:12:55 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:56 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7072da54-de69-4fe5-a7c4-77028f86b532" returned: 0 in 1.315s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] <== create_volume: return (3565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:12:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.569s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:12:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d4fe28b-9c87-4a02-b04f-e8ca48d67260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7072da54-de69-4fe5-a7c4-77028f86b532', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad1ad8e-192b-42d4-a3db-ab17bac54a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:56 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Volume volume-7072da54-de69-4fe5-a7c4-77028f86b532 (7072da54-de69-4fe5-a7c4-77028f86b532): created successfully Jul 09 14:12:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad1ad8e-192b-42d4-a3db-ab17bac54a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Flow 'volume_create_manager' (e4c17af1-45e3-49ab-9be7-6fbfb6d01e4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:12:56 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d9467475-93c2-40f2-b46c-1d1a9301744d tempest-VolumeQuotasAdminTestJSON-189648551 None] Created volume successfully. Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Flow 'volume_create_manager' (a6f4ce08-fca7-4746-895c-673593f61198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca58f81-aad3-46ef-b443-70a134c79d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca58f81-aad3-46ef-b443-70a134c79d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1142400133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af265470-e4a4-4bab-8d73-b5dec64543c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1b3637ac1b40c29f187eb07a5941af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:12:58Z,use_quota=True,user_id='836732860b964f0e8df9dfc001172646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677f41c8-131a-4d39-acba-484620b5b6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677f41c8-131a-4d39-acba-484620b5b6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a14dc8-006a-4fd7-888e-8fd7d067f30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a14dc8-006a-4fd7-888e-8fd7d067f30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af265470-e4a4-4bab-8d73-b5dec64543c6', 'volume_name': 'volume-af265470-e4a4-4bab-8d73-b5dec64543c6', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1443da6c-3295-41d0-bfa5-85a327352c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1443da6c-3295-41d0-bfa5-85a327352c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1d8d76-2a3a-4b44-adb7-2629f50cefca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:12:58 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Volume af265470-e4a4-4bab-8d73-b5dec64543c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af265470-e4a4-4bab-8d73-b5dec64543c6', 'volume_size': 1} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1142400133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af265470-e4a4-4bab-8d73-b5dec64543c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1b3637ac1b40c29f187eb07a5941af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:12:58Z,use_quota=True,user_id='836732860b964f0e8df9dfc001172646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Creating volume af265470-e4a4-4bab-8d73-b5dec64543c6 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:12:58 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:12:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-af265470-e4a4-4bab-8d73-b5dec64543c6 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:58 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a39b3b7c-2dbb-4265-b92c-bd14814b2d08 tempest-VolumeQuotasAdminTestJSON-605292019 None] Transfer volume completed successfully. Jul 09 14:12:58 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-af265470-e4a4-4bab-8d73-b5dec64543c6 1073741824 Jul 09 14:12:58 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:12:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] Acquiring lock "cinder-7072da54-de69-4fe5-a7c4-77028f86b532-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:12:59 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Jul 09 14:12:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] Lock "cinder-7072da54-de69-4fe5-a7c4-77028f86b532-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:12:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-af265470-e4a4-4bab-8d73-b5dec64543c6 1073741824" returned: 0 in 1.147s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:12:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-af265470-e4a4-4bab-8d73-b5dec64543c6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:12:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] Acquiring lock "cinder-quobyte-7072da54-de69-4fe5-a7c4-77028f86b532" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:12:59 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-af265470-e4a4-4bab-8d73-b5dec64543c6 Jul 09 14:12:59 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:00 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] Lock "cinder-quobyte-7072da54-de69-4fe5-a7c4-77028f86b532" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:00 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9904d3-ad53-4910-8d9b-ac8769a06fd7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:13:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7072da54-de69-4fe5-a7c4-77028f86b532 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:00 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7072da54-de69-4fe5-a7c4-77028f86b532 Jul 09 14:13:00 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-af7cc52c-27ca-41c0-bdf8-831f7a0255a8 tempest-BackendsCapabilitiesAdminTestsJSON-615745547 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7545547485352, 'free_capacity_gb': 1775.7545547485352, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87011) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 14:13:00 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-af265470-e4a4-4bab-8d73-b5dec64543c6" returned: 0 in 0.685s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:13:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1d8d76-2a3a-4b44-adb7-2629f50cefca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af265470-e4a4-4bab-8d73-b5dec64543c6', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055d93e3-f7fd-48c3-9b83-75eb12854f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:00 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Volume volume-af265470-e4a4-4bab-8d73-b5dec64543c6 (af265470-e4a4-4bab-8d73-b5dec64543c6): created successfully Jul 09 14:13:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055d93e3-f7fd-48c3-9b83-75eb12854f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Flow 'volume_create_manager' (a6f4ce08-fca7-4746-895c-673593f61198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:13:00 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-0840f6a1-bece-4163-a25e-d488623ca758 tempest-ServersNegativeTestJSON-1687242318 None] Created volume successfully. Jul 09 14:13:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5afcd16d-b117-465b-97c3-73616dd760ab tempest-BackendsCapabilitiesAdminTestsJSON-615745547 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7545547485352, 'free_capacity_gb': 1775.7545547485352, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87011) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 14:13:00 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7072da54-de69-4fe5-a7c4-77028f86b532" returned: 0 in 0.875s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7072da54-de69-4fe5-a7c4-77028f86b532 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:00 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7072da54-de69-4fe5-a7c4-77028f86b532 Jul 09 14:13:00 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:01 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7072da54-de69-4fe5-a7c4-77028f86b532" returned: 0 in 0.733s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] Lock "cinder-quobyte-7072da54-de69-4fe5-a7c4-77028f86b532" released by "delete_volume" :: held 1.651s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:13:01 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] Created reservations ['81917143-5f9d-4eca-8b2d-ead7267a76f1', 'daaaef07-8050-4cf3-baf0-ca53866ff6ce', 'c182fc3b-5a8c-4f0b-8cd3-3beaf0edd021', '84165cdb-c665-44dc-a37e-e3d08c96090c'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:13:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:01 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:13:01 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:13:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:01 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:13:01 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:02 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.074s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:02 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:13:02 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] Deleted volume successfully. Jul 09 14:13:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4c088926-b097-48bb-91a2-6be1f1d0982a tempest-VolumeQuotasAdminTestJSON-1641859480 None] Lock "cinder-7072da54-de69-4fe5-a7c4-77028f86b532-delete_volume" released by "delete_volume" :: held 3.068s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Flow 'volume_create_manager' (4f09467a-53d8-414d-b397-6d540902bea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (262c0db1-d19c-4fdd-ae4d-b07870b96d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (262c0db1-d19c-4fdd-ae4d-b07870b96d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-667694622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b42416-16fe-4c45-83d6-688dd4249268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1b3637ac1b40c29f187eb07a5941af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:13:04Z,use_quota=True,user_id='836732860b964f0e8df9dfc001172646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08dafd74-f641-457a-a17e-4a1957ef8aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08dafd74-f641-457a-a17e-4a1957ef8aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d9f2c8-194e-4e81-a458-8c61c2207661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d9f2c8-194e-4e81-a458-8c61c2207661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b42416-16fe-4c45-83d6-688dd4249268', 'volume_name': 'volume-90b42416-16fe-4c45-83d6-688dd4249268', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6084a54-43aa-4fd0-bd40-1b196ab17dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6084a54-43aa-4fd0-bd40-1b196ab17dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3594c4f4-b169-42ca-8419-1e63ecd05a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:04 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Volume 90b42416-16fe-4c45-83d6-688dd4249268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b42416-16fe-4c45-83d6-688dd4249268', 'volume_size': 1} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-667694622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b42416-16fe-4c45-83d6-688dd4249268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc1b3637ac1b40c29f187eb07a5941af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:13:04Z,use_quota=True,user_id='836732860b964f0e8df9dfc001172646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Creating volume 90b42416-16fe-4c45-83d6-688dd4249268 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:13:04 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:13:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90b42416-16fe-4c45-83d6-688dd4249268 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:04 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90b42416-16fe-4c45-83d6-688dd4249268 1073741824 Jul 09 14:13:04 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:05 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90b42416-16fe-4c45-83d6-688dd4249268 1073741824" returned: 0 in 1.454s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90b42416-16fe-4c45-83d6-688dd4249268 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:05 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90b42416-16fe-4c45-83d6-688dd4249268 Jul 09 14:13:05 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:06 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:13:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Flow 'volume_create_manager' (094a58f2-d696-4e1a-ba2d-d8e75a83d604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:13:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9719218f-cb01-4282-9acc-d53fc91578d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9719218f-cb01-4282-9acc-d53fc91578d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1276532587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b38e1b-4346-406a-a648-156dee681cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0c1d9961d324de799e5419490511eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:13:06Z,use_quota=True,user_id='5ebca124bb3a4cb59ea5470daf7d698a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ab59a4-7dff-4c1b-8a6e-bbd45f90bdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ab59a4-7dff-4c1b-8a6e-bbd45f90bdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5843f7c5-a03e-4586-adfd-c7475ea7beed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5843f7c5-a03e-4586-adfd-c7475ea7beed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3b38e1b-4346-406a-a648-156dee681cb1', 'volume_name': 'volume-f3b38e1b-4346-406a-a648-156dee681cb1', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4104f129-171b-4026-b77a-59e717423ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4104f129-171b-4026-b77a-59e717423ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d012f40-5fbf-47d2-9066-540f37ef8438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:06 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Volume f3b38e1b-4346-406a-a648-156dee681cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3b38e1b-4346-406a-a648-156dee681cb1', 'volume_size': 1} Jul 09 14:13:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:07 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90b42416-16fe-4c45-83d6-688dd4249268" returned: 0 in 1.329s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] <== create_volume: return (2866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:13:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.873s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.868s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1276532587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b38e1b-4346-406a-a648-156dee681cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0c1d9961d324de799e5419490511eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:13:06Z,use_quota=True,user_id='5ebca124bb3a4cb59ea5470daf7d698a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:13:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Creating volume f3b38e1b-4346-406a-a648-156dee681cb1 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:13:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:13:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:13:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:13:07 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:13:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f3b38e1b-4346-406a-a648-156dee681cb1 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:07 devstack sudo[93636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f3b38e1b-4346-406a-a648-156dee681cb1 1073741824 Jul 09 14:13:07 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3594c4f4-b169-42ca-8419-1e63ecd05a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b42416-16fe-4c45-83d6-688dd4249268', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f876ef-d774-475e-9d83-53091253fd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:07 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Volume volume-90b42416-16fe-4c45-83d6-688dd4249268 (90b42416-16fe-4c45-83d6-688dd4249268): created successfully Jul 09 14:13:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f876ef-d774-475e-9d83-53091253fd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Flow 'volume_create_manager' (4f09467a-53d8-414d-b397-6d540902bea5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:13:07 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-734e4b1b-b79c-4301-9d38-1cf1061dddc6 tempest-ServersNegativeTestJSON-1687242318 None] Created volume successfully. Jul 09 14:13:08 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f3b38e1b-4346-406a-a648-156dee681cb1 1073741824" returned: 0 in 1.487s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f3b38e1b-4346-406a-a648-156dee681cb1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:08 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f3b38e1b-4346-406a-a648-156dee681cb1 Jul 09 14:13:08 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] Acquiring lock "cinder-90b42416-16fe-4c45-83d6-688dd4249268-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] Lock "cinder-90b42416-16fe-4c45-83d6-688dd4249268-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] Acquiring lock "cinder-quobyte-90b42416-16fe-4c45-83d6-688dd4249268" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] Lock "cinder-quobyte-90b42416-16fe-4c45-83d6-688dd4249268" acquired by "delete_volume" :: waited 0.028s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:10 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4a5d97-cd05-4af6-857c-6b5410b2c354]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:13:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90b42416-16fe-4c45-83d6-688dd4249268 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:10 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90b42416-16fe-4c45-83d6-688dd4249268 Jul 09 14:13:10 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:10 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f3b38e1b-4346-406a-a648-156dee681cb1" returned: 0 in 1.651s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] <== create_volume: return (3219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:13:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.224s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d012f40-5fbf-47d2-9066-540f37ef8438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3b38e1b-4346-406a-a648-156dee681cb1', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9499753a-6eda-472b-8493-dec2320b0234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:10 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Volume volume-f3b38e1b-4346-406a-a648-156dee681cb1 (f3b38e1b-4346-406a-a648-156dee681cb1): created successfully Jul 09 14:13:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9499753a-6eda-472b-8493-dec2320b0234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Flow 'volume_create_manager' (094a58f2-d696-4e1a-ba2d-d8e75a83d604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:13:10 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-552d0b65-de8b-4c3b-aa8c-1c767286b86a tempest-ServerRescueNegativeTestJSON-431758492 None] Created volume successfully. Jul 09 14:13:11 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90b42416-16fe-4c45-83d6-688dd4249268" returned: 0 in 0.951s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90b42416-16fe-4c45-83d6-688dd4249268 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:11 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90b42416-16fe-4c45-83d6-688dd4249268 Jul 09 14:13:11 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:11 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-90b42416-16fe-4c45-83d6-688dd4249268" returned: 0 in 0.979s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] Lock "cinder-quobyte-90b42416-16fe-4c45-83d6-688dd4249268" released by "delete_volume" :: held 2.007s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:13:12 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] Created reservations ['2179ca72-053d-4863-855d-f4085b5bf1bc', 'b7e86869-e875-41cf-87b1-7ba6e9e8fb46', '399db315-8dde-48e5-afcb-04833ea3f934', '276ae0ac-192c-4a5f-8cc9-8aff1264cd7b'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:13:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:13:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:13:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:12 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:13:12 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:13:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:13:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:13:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:12 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:13:12 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] Acquiring lock "cinder-af265470-e4a4-4bab-8d73-b5dec64543c6-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:13 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.241s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:13:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] Lock "cinder-af265470-e4a4-4bab-8d73-b5dec64543c6-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:13 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] Deleted volume successfully. Jul 09 14:13:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3c3ace87-dbcd-4bf6-b5c7-521e4e0bc08a tempest-ServersNegativeTestJSON-1687242318 None] Lock "cinder-90b42416-16fe-4c45-83d6-688dd4249268-delete_volume" released by "delete_volume" :: held 3.765s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:13:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] Acquiring lock "cinder-quobyte-af265470-e4a4-4bab-8d73-b5dec64543c6" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] Lock "cinder-quobyte-af265470-e4a4-4bab-8d73-b5dec64543c6" acquired by "delete_volume" :: waited 0.036s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:13 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1b3be4-5787-4a39-b155-78ed11b5c5bc]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:13:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-af265470-e4a4-4bab-8d73-b5dec64543c6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:13 devstack sudo[93668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-af265470-e4a4-4bab-8d73-b5dec64543c6 Jul 09 14:13:13 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:14 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.528s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 8 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Flow 'volume_create_manager' (55760c1e-cb31-4ca7-b25d-95ea9774965d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5aebd7-18e7-4804-b3fa-5fc0e7ac1aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5aebd7-18e7-4804-b3fa-5fc0e7ac1aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-373009331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=844d0a34-ae82-477d-acdb-e05135991860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f3a913c62946ce8b8cef01487c94fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:13:15Z,use_quota=True,user_id='79a2b1684d854a929cf333c8d6fc80d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5fc49db-d8d9-4258-99d5-4ecec82a0b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5fc49db-d8d9-4258-99d5-4ecec82a0b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c290f909-ea96-46ea-a404-f405df1ea061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c290f909-ea96-46ea-a404-f405df1ea061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '844d0a34-ae82-477d-acdb-e05135991860', 'volume_name': 'volume-844d0a34-ae82-477d-acdb-e05135991860', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3ea7b3-22cd-4594-ad98-7d7644bbde9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3ea7b3-22cd-4594-ad98-7d7644bbde9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd4ac51-a3f5-4c75-b926-8550138932c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:14 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Volume 844d0a34-ae82-477d-acdb-e05135991860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-844d0a34-ae82-477d-acdb-e05135991860', 'volume_size': 1} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-373009331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=844d0a34-ae82-477d-acdb-e05135991860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f3a913c62946ce8b8cef01487c94fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:13:15Z,use_quota=True,user_id='79a2b1684d854a929cf333c8d6fc80d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Creating volume 844d0a34-ae82-477d-acdb-e05135991860 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:13:14 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:13:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-844d0a34-ae82-477d-acdb-e05135991860 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:15 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-844d0a34-ae82-477d-acdb-e05135991860 1073741824 Jul 09 14:13:15 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:15 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-af265470-e4a4-4bab-8d73-b5dec64543c6" returned: 0 in 1.341s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-af265470-e4a4-4bab-8d73-b5dec64543c6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:15 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-af265470-e4a4-4bab-8d73-b5dec64543c6 Jul 09 14:13:15 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:16 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-af265470-e4a4-4bab-8d73-b5dec64543c6" returned: 0 in 0.993s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] Lock "cinder-quobyte-af265470-e4a4-4bab-8d73-b5dec64543c6" released by "delete_volume" :: held 2.440s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:13:16 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] Created reservations ['0bf9408c-726b-49ff-a5b6-ca9a4eea2601', '4b2a1297-543c-4f6f-880d-a3ded7f49c81', '297d3110-2458-4d66-800c-1abb6ae20744', '70078146-f827-46f0-aff4-f9f130ad1ce7'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:13:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:13:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:13:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:16 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:13:16 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:16 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-844d0a34-ae82-477d-acdb-e05135991860 1073741824" returned: 0 in 1.470s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-844d0a34-ae82-477d-acdb-e05135991860 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:16 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-844d0a34-ae82-477d-acdb-e05135991860 Jul 09 14:13:16 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:17 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.023s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:17 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:13:17 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] Deleted volume successfully. Jul 09 14:13:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-67466afb-4f9d-45ee-92cf-823b9a769ef0 tempest-ServersNegativeTestJSON-1687242318 None] Lock "cinder-af265470-e4a4-4bab-8d73-b5dec64543c6-delete_volume" released by "delete_volume" :: held 3.866s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:13:17 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-844d0a34-ae82-477d-acdb-e05135991860" returned: 0 in 1.073s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] <== create_volume: return (2596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:13:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.599s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd4ac51-a3f5-4c75-b926-8550138932c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-844d0a34-ae82-477d-acdb-e05135991860', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c182d12a-2f86-4aa1-a830-9ed236b3d6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:17 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Volume volume-844d0a34-ae82-477d-acdb-e05135991860 (844d0a34-ae82-477d-acdb-e05135991860): created successfully Jul 09 14:13:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c182d12a-2f86-4aa1-a830-9ed236b3d6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Flow 'volume_create_manager' (55760c1e-cb31-4ca7-b25d-95ea9774965d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:13:17 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-787c6921-cfff-4dc7-a463-3a45b6e06f1b tempest-VolumesServicesTestJSON-353492683 None] Created volume successfully. Jul 09 14:13:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] Acquiring lock "cinder-844d0a34-ae82-477d-acdb-e05135991860-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] Lock "cinder-844d0a34-ae82-477d-acdb-e05135991860-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] Acquiring lock "cinder-quobyte-844d0a34-ae82-477d-acdb-e05135991860" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] Lock "cinder-quobyte-844d0a34-ae82-477d-acdb-e05135991860" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:18 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b866701-c11d-42a9-9270-d397d7e1eff0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:13:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-844d0a34-ae82-477d-acdb-e05135991860 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:18 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-844d0a34-ae82-477d-acdb-e05135991860 Jul 09 14:13:18 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:19 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-844d0a34-ae82-477d-acdb-e05135991860" returned: 0 in 0.874s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-844d0a34-ae82-477d-acdb-e05135991860 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:19 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-844d0a34-ae82-477d-acdb-e05135991860 Jul 09 14:13:19 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:20 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-844d0a34-ae82-477d-acdb-e05135991860" returned: 0 in 0.949s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:20 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] Lock "cinder-quobyte-844d0a34-ae82-477d-acdb-e05135991860" released by "delete_volume" :: held 1.889s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:13:20 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] Created reservations ['21074048-7873-4727-9cda-cb4ad4eab0c1', 'c23f0e91-6635-48df-bc36-58189a5ae0be', '7874b512-2a59-492c-899b-a31e464ef7b1', '4eee301e-574e-4db8-b9d1-ab3f099bbaa9'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:13:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:13:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:13:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:20 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:13:20 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:21 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.848s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:21 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:13:21 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] Deleted volume successfully. Jul 09 14:13:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-59af3308-8167-4e2e-b2a3-0cdf6cb61226 tempest-VolumesServicesTestJSON-353492683 None] Lock "cinder-844d0a34-ae82-477d-acdb-e05135991860-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=54,cinder:INSERT=17,cinder:UPDATE=94,cinder:DELETE=10 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=72,cinder:SELECT=53,cinder:INSERT=21,cinder:DELETE=4 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Flow 'volume_create_manager' (84a54721-d0a1-4efa-a537-31a01d1a7431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe0787a-fddb-4ed8-9d63-eb851583acb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe0787a-fddb-4ed8-9d63-eb851583acb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-879525287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18affc7-0cd3-4472-8dfd-5fca97398d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d4108f13e74e118c916234be00ffbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:13:29Z,use_quota=True,user_id='a2acb937e757438faab6a6b106955019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f29cc5de-e6d5-4546-9509-1d319ff47962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f29cc5de-e6d5-4546-9509-1d319ff47962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1e1490-5630-422a-9b24-6be4229a970e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b1e1490-5630-422a-9b24-6be4229a970e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f18affc7-0cd3-4472-8dfd-5fca97398d45', 'volume_name': 'volume-f18affc7-0cd3-4472-8dfd-5fca97398d45', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f542462-31d4-41dc-a9c0-dc38e9bd1f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f542462-31d4-41dc-a9c0-dc38e9bd1f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9942841-1f1a-4bb4-a9ba-a769e9851d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:29 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Volume f18affc7-0cd3-4472-8dfd-5fca97398d45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f18affc7-0cd3-4472-8dfd-5fca97398d45', 'volume_size': 1} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-879525287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18affc7-0cd3-4472-8dfd-5fca97398d45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4d4108f13e74e118c916234be00ffbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:13:29Z,use_quota=True,user_id='a2acb937e757438faab6a6b106955019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Creating volume f18affc7-0cd3-4472-8dfd-5fca97398d45 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:13:29 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:13:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:29 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45 1073741824 Jul 09 14:13:29 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:30 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45 1073741824" returned: 0 in 1.375s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:30 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45 Jul 09 14:13:30 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:31 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45" returned: 0 in 1.177s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] <== create_volume: return (2679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:13:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.684s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9942841-1f1a-4bb4-a9ba-a769e9851d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f18affc7-0cd3-4472-8dfd-5fca97398d45', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade05654-ee52-481c-9061-cd71bb7a7826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:32 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Volume volume-f18affc7-0cd3-4472-8dfd-5fca97398d45 (f18affc7-0cd3-4472-8dfd-5fca97398d45): created successfully Jul 09 14:13:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade05654-ee52-481c-9061-cd71bb7a7826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Flow 'volume_create_manager' (84a54721-d0a1-4efa-a537-31a01d1a7431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:13:32 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9d37982d-c242-4b8e-b463-5ba431d0ef59 tempest-SnapshotsActionsTest-1268948013 None] Created volume successfully. Jul 09 14:13:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] Acquiring lock "cinder-f3b38e1b-4346-406a-a648-156dee681cb1-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] Lock "cinder-f3b38e1b-4346-406a-a648-156dee681cb1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] Acquiring lock "cinder-quobyte-f3b38e1b-4346-406a-a648-156dee681cb1" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] Lock "cinder-quobyte-f3b38e1b-4346-406a-a648-156dee681cb1" acquired by "delete_volume" :: waited 0.042s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:32 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[b032390d-2160-4f40-b8ff-7e6f4d5f5ed2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:13:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f3b38e1b-4346-406a-a648-156dee681cb1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:32 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f3b38e1b-4346-406a-a648-156dee681cb1 Jul 09 14:13:32 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] Creating offline snapshot 8922a185-57ed-4564-b255-b0e5b549a365 of volume f18affc7-0cd3-4472-8dfd-5fca97398d45 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:13:33 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f81050-cf6b-4322-a1c9-fa533630cc3d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:13:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:33 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45 Jul 09 14:13:33 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:33 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f3b38e1b-4346-406a-a648-156dee681cb1" returned: 0 in 1.342s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f3b38e1b-4346-406a-a648-156dee681cb1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:33 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f3b38e1b-4346-406a-a648-156dee681cb1 Jul 09 14:13:33 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:34 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45" returned: 0 in 1.391s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:34 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 1G Jul 09 14:13:34 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:34 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f3b38e1b-4346-406a-a648-156dee681cb1" returned: 0 in 0.916s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] Lock "cinder-quobyte-f3b38e1b-4346-406a-a648-156dee681cb1" released by "delete_volume" :: held 2.340s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:13:34 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] Created reservations ['10190924-5d85-4209-b843-458a7512ce10', '120e81c6-b8b8-4e6e-be92-898249fe7389', '8fbb31b9-05fe-4268-bb03-42e85054718b', '74ed5cb1-8e59-442a-a9d4-0e2853dfd120'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:13:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:13:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:13:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:35 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:13:35 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:35 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 1G" returned: 0 in 1.457s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18affc7-0cd3-4472-8dfd-5fca97398d45 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:35 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18affc7-0cd3-4472-8dfd-5fca97398d45 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 Jul 09 14:13:35 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:36 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.218s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:36 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:13:36 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] Deleted volume successfully. Jul 09 14:13:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bce7f07c-f8a7-4f4f-8765-5299d57d3939 tempest-ServerRescueNegativeTestJSON-431758492 None] Lock "cinder-f3b38e1b-4346-406a-a648-156dee681cb1-delete_volume" released by "delete_volume" :: held 4.047s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:13:37 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18affc7-0cd3-4472-8dfd-5fca97398d45 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365" returned: 0 in 1.460s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:37 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 is being set with open permissions: ugo+rw Jul 09 14:13:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:37 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 Jul 09 14:13:37 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:37 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:13:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Flow 'volume_create_manager' (79e50c9d-439f-4151-aff7-9e9c5a49fa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:13:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884b9a7c-a0c5-4c60-9855-0692e3c6c97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884b9a7c-a0c5-4c60-9855-0692e3c6c97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-147777302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=935c2025-47aa-4451-b94d-3d8621ecb4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8243fcd24844c7980436c47e0b4573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:13:38Z,use_quota=True,user_id='37dcbcc7e0f849119f3afe5a4e7edca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e7f0a26-41a1-4492-8663-1a7b002cae68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e7f0a26-41a1-4492-8663-1a7b002cae68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f154fb-e9eb-4c17-945c-89e89594d240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f154fb-e9eb-4c17-945c-89e89594d240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '935c2025-47aa-4451-b94d-3d8621ecb4c1', 'volume_name': 'volume-935c2025-47aa-4451-b94d-3d8621ecb4c1', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77a96b4-e999-4024-8e58-6421c5d9f3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77a96b4-e999-4024-8e58-6421c5d9f3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f18c4d-3ebc-41c0-8901-1af190c346c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:38 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Volume 935c2025-47aa-4451-b94d-3d8621ecb4c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-935c2025-47aa-4451-b94d-3d8621ecb4c1', 'volume_size': 1} Jul 09 14:13:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:38 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365" returned: 0 in 0.928s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:38 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.info Jul 09 14:13:38 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:39 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.info" returned: 0 in 1.042s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:39 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.info is being set with open permissions: ugo+rw Jul 09 14:13:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:39 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.info Jul 09 14:13:39 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:40 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.info" returned: 0 in 0.864s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.322s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.156s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-147777302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=935c2025-47aa-4451-b94d-3d8621ecb4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a8243fcd24844c7980436c47e0b4573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:13:38Z,use_quota=True,user_id='37dcbcc7e0f849119f3afe5a4e7edca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:13:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Creating volume 935c2025-47aa-4451-b94d-3d8621ecb4c1 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:13:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:13:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:13:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:13:40 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:13:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:40 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1 1073741824 Jul 09 14:13:40 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:40 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-f116ffef-a32a-46fe-9f45-34a15da895ea tempest-SnapshotsActionsTest-1268948013 None] Create snapshot completed successfully Jul 09 14:13:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-205c7311-117f-487d-8c9e-4b9cd89531d5 tempest-SnapshotsActionsTest-1268948013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:41 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1 1073741824" returned: 0 in 1.249s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:41 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1 Jul 09 14:13:41 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:42 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1" returned: 0 in 0.898s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] <== create_volume: return (2201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:13:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.205s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-205c7311-117f-487d-8c9e-4b9cd89531d5 tempest-SnapshotsActionsTest-1268948013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.049s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f18c4d-3ebc-41c0-8901-1af190c346c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-935c2025-47aa-4451-b94d-3d8621ecb4c1', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37d9f52-0535-4532-8b31-d2cce9470708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:13:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-205c7311-117f-487d-8c9e-4b9cd89531d5 tempest-SnapshotsActionsTest-1268948013 None] Creating offline snapshot ce06e7c2-5c64-4c63-bfaa-6f142316019c of volume f18affc7-0cd3-4472-8dfd-5fca97398d45 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:13:42 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Volume volume-935c2025-47aa-4451-b94d-3d8621ecb4c1 (935c2025-47aa-4451-b94d-3d8621ecb4c1): created successfully Jul 09 14:13:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37d9f52-0535-4532-8b31-d2cce9470708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:13:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Flow 'volume_create_manager' (79e50c9d-439f-4151-aff7-9e9c5a49fa29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:13:42 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04d850e-763b-4594-a60a-5ac2b8e4664f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:13:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-205c7311-117f-487d-8c9e-4b9cd89531d5 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:42 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-52263231-348a-471d-b870-8f12549259eb tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Created volume successfully. Jul 09 14:13:42 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 Jul 09 14:13:42 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:43 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-205c7311-117f-487d-8c9e-4b9cd89531d5 tempest-SnapshotsActionsTest-1268948013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365" returned: 0 in 0.937s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:43 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-205c7311-117f-487d-8c9e-4b9cd89531d5 tempest-SnapshotsActionsTest-1268948013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18affc7-0cd3-4472-8dfd-5fca97398d45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:13:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-205c7311-117f-487d-8c9e-4b9cd89531d5 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:43 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c 1G Jul 09 14:13:43 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:44 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-205c7311-117f-487d-8c9e-4b9cd89531d5 tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c 1G" returned: 0 in 1.018s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-205c7311-117f-487d-8c9e-4b9cd89531d5 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:44 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c Jul 09 14:13:44 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:45 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-205c7311-117f-487d-8c9e-4b9cd89531d5 tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c" returned: 0 in 0.721s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:45 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-205c7311-117f-487d-8c9e-4b9cd89531d5 tempest-SnapshotsActionsTest-1268948013 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c is being set with open permissions: ugo+rw Jul 09 14:13:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-205c7311-117f-487d-8c9e-4b9cd89531d5 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:45 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c Jul 09 14:13:45 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:46 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-205c7311-117f-487d-8c9e-4b9cd89531d5 tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c" returned: 0 in 0.793s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-205c7311-117f-487d-8c9e-4b9cd89531d5 tempest-SnapshotsActionsTest-1268948013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.634s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.513s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Creating offline snapshot c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb of volume 935c2025-47aa-4451-b94d-3d8621ecb4c1 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:13:46 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-205c7311-117f-487d-8c9e-4b9cd89531d5 tempest-SnapshotsActionsTest-1268948013 None] Create snapshot completed successfully Jul 09 14:13:46 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d48398-9648-47e3-b30b-aece898af7b4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:13:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:46 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1 Jul 09 14:13:46 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] Acquiring lock "cinder-ce06e7c2-5c64-4c63-bfaa-6f142316019c-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-ce06e7c2-5c64-4c63-bfaa-6f142316019c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] Acquiring lock "cinder-quobyte-f18affc7-0cd3-4472-8dfd-5fca97398d45" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-quobyte-f18affc7-0cd3-4472-8dfd-5fca97398d45" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] Acquiring lock "cinder-quobyte-ce06e7c2-5c64-4c63-bfaa-6f142316019c" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-quobyte-ce06e7c2-5c64-4c63-bfaa-6f142316019c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] Deleting offline snapshot ce06e7c2-5c64-4c63-bfaa-6f142316019c of volume f18affc7-0cd3-4472-8dfd-5fca97398d45 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:13:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] snapshot_file for this snap is: volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:13:47 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2752c93-63df-42e6-983e-8aaf143bef5e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:13:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:47 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1" returned: 0 in 1.062s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:47 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c Jul 09 14:13:47 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:47 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb 1G Jul 09 14:13:47 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:48 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c" returned: 0 in 0.950s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18affc7-0cd3-4472-8dfd-5fca97398d45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:13:48 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee6d42f-5d9a-4058-b631-f3a7a0bf9751]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:13:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:48 devstack sudo[93967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 Jul 09 14:13:48 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:48 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb 1G" returned: 0 in 0.997s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-935c2025-47aa-4451-b94d-3d8621ecb4c1 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:48 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-935c2025-47aa-4451-b94d-3d8621ecb4c1 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb Jul 09 14:13:48 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:49 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365" returned: 0 in 0.890s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:49 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18affc7-0cd3-4472-8dfd-5fca97398d45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:13:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:49 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c Jul 09 14:13:49 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:49 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-935c2025-47aa-4451-b94d-3d8621ecb4c1 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb" returned: 0 in 0.775s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:49 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb is being set with open permissions: ugo+rw Jul 09 14:13:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:49 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb Jul 09 14:13:49 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:49 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb" returned: 0 in 0.660s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:49 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.info Jul 09 14:13:49 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:49 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c" returned: 0 in 0.894s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:49 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c Jul 09 14:13:49 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:50 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.info" returned: 0 in 0.695s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:50 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.info is being set with open permissions: ugo+rw Jul 09 14:13:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:50 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.info Jul 09 14:13:50 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:50 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ce06e7c2-5c64-4c63-bfaa-6f142316019c" returned: 0 in 0.794s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:50 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-quobyte-ce06e7c2-5c64-4c63-bfaa-6f142316019c" released by "_delete_snapshot" :: held 3.679s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:13:50 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-quobyte-f18affc7-0cd3-4472-8dfd-5fca97398d45" released by "delete_snapshot" :: held 3.708s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:13:50 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] Created reservations ['f847e04a-c306-4a91-b4ba-7654053ce8e3', '93505351-31a5-40d6-b04c-39c55abadb65', '14429707-abec-4d68-9953-34b91a3219e4', 'a423d00c-e998-438a-9a86-d8b618078996'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:13:50 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] Delete snapshot completed successfully. Jul 09 14:13:50 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e15be02e-d4c9-4e0f-ba25-5e2a1d1ffa58 tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-ce06e7c2-5c64-4c63-bfaa-6f142316019c-delete_snapshot" released by "delete_snapshot" :: held 3.859s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:13:51 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.info" returned: 0 in 0.664s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.987s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:51 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-e5d1d9b8-bd09-4946-8535-80693a6a486a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Create snapshot completed successfully Jul 09 14:13:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d2e91d62-ee1b-4501-8e5b-f761a49786eb tempest-SnapshotsActionsTest-1268948013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d2e91d62-ee1b-4501-8e5b-f761a49786eb tempest-SnapshotsActionsTest-1268948013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d2e91d62-ee1b-4501-8e5b-f761a49786eb tempest-SnapshotsActionsTest-1268948013 None] Creating offline snapshot 96c8a65a-30e5-4179-a200-3f4cd461b4d7 of volume f18affc7-0cd3-4472-8dfd-5fca97398d45 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:13:51 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1cc66d-f0a7-4461-b368-978f9b6d6cb2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:13:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d2e91d62-ee1b-4501-8e5b-f761a49786eb tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:52 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 Jul 09 14:13:52 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Acquiring lock "cinder-c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Lock "cinder-c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Acquiring lock "cinder-quobyte-935c2025-47aa-4451-b94d-3d8621ecb4c1" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Lock "cinder-quobyte-935c2025-47aa-4451-b94d-3d8621ecb4c1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Acquiring lock "cinder-quobyte-c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Lock "cinder-quobyte-c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Deleting offline snapshot c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb of volume 935c2025-47aa-4451-b94d-3d8621ecb4c1 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:13:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] snapshot_file for this snap is: volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:13:52 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[c366e691-cb37-4a5e-91b0-19aac90a9d6b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:13:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:53 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d2e91d62-ee1b-4501-8e5b-f761a49786eb tempest-SnapshotsActionsTest-1268948013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365" returned: 0 in 1.121s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:53 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb Jul 09 14:13:53 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d2e91d62-ee1b-4501-8e5b-f761a49786eb tempest-SnapshotsActionsTest-1268948013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18affc7-0cd3-4472-8dfd-5fca97398d45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:13:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d2e91d62-ee1b-4501-8e5b-f761a49786eb tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:53 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7 1G Jul 09 14:13:53 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:53 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb" returned: 0 in 0.984s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-935c2025-47aa-4451-b94d-3d8621ecb4c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:13:53 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[7341c448-82ad-428b-aa4f-f411ce65988c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:13:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:54 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1 Jul 09 14:13:54 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:54 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d2e91d62-ee1b-4501-8e5b-f761a49786eb tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7 1G" returned: 0 in 1.079s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d2e91d62-ee1b-4501-8e5b-f761a49786eb tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:54 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7 Jul 09 14:13:54 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:54 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1" returned: 0 in 0.953s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:54 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb Jul 09 14:13:54 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:55 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d2e91d62-ee1b-4501-8e5b-f761a49786eb tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7" returned: 0 in 0.901s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:55 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-d2e91d62-ee1b-4501-8e5b-f761a49786eb tempest-SnapshotsActionsTest-1268948013 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7 is being set with open permissions: ugo+rw Jul 09 14:13:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d2e91d62-ee1b-4501-8e5b-f761a49786eb tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:55 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7 Jul 09 14:13:55 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:55 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d2e91d62-ee1b-4501-8e5b-f761a49786eb tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7" returned: 0 in 0.843s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d2e91d62-ee1b-4501-8e5b-f761a49786eb tempest-SnapshotsActionsTest-1268948013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.070s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:55 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb" returned: 0 in 1.069s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:55 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d2e91d62-ee1b-4501-8e5b-f761a49786eb tempest-SnapshotsActionsTest-1268948013 None] Create snapshot completed successfully Jul 09 14:13:55 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb Jul 09 14:13:55 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] Acquiring lock "cinder-96c8a65a-30e5-4179-a200-3f4cd461b4d7-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-96c8a65a-30e5-4179-a200-3f4cd461b4d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] Acquiring lock "cinder-quobyte-f18affc7-0cd3-4472-8dfd-5fca97398d45" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-quobyte-f18affc7-0cd3-4472-8dfd-5fca97398d45" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] Acquiring lock "cinder-quobyte-96c8a65a-30e5-4179-a200-3f4cd461b4d7" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-quobyte-96c8a65a-30e5-4179-a200-3f4cd461b4d7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] Deleting offline snapshot 96c8a65a-30e5-4179-a200-3f4cd461b4d7 of volume f18affc7-0cd3-4472-8dfd-5fca97398d45 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:13:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] snapshot_file for this snap is: volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:13:56 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6d6230-4681-4af3-b557-a748de8ddd9b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:13:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:56 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7 Jul 09 14:13:56 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:56 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1.c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb" returned: 0 in 0.803s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Lock "cinder-quobyte-c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb" released by "_delete_snapshot" :: held 3.945s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:13:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Lock "cinder-quobyte-935c2025-47aa-4451-b94d-3d8621ecb4c1" released by "delete_snapshot" :: held 3.984s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:13:56 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Created reservations ['de8d8230-08ed-4f80-b5d8-7da60fb36195', 'd1ae7079-ecdf-4fcf-9dc1-fac65d5a53b7', '8b5d4178-19af-47d8-a1b4-8c34acc3699f', '332158d0-0e47-4a1e-ba6d-b88e6678561d'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:13:57 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Delete snapshot completed successfully. Jul 09 14:13:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-00226dff-3af2-49e2-af61-cd45c26d7bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Lock "cinder-c4238dcc-5b4a-4a54-8aaa-7dbd3458b0eb-delete_snapshot" released by "delete_snapshot" :: held 4.283s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:13:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Acquiring lock "cinder-935c2025-47aa-4451-b94d-3d8621ecb4c1-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Lock "cinder-935c2025-47aa-4451-b94d-3d8621ecb4c1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Acquiring lock "cinder-quobyte-935c2025-47aa-4451-b94d-3d8621ecb4c1" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:13:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Lock "cinder-quobyte-935c2025-47aa-4451-b94d-3d8621ecb4c1" acquired by "delete_volume" :: waited 0.026s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:13:57 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7" returned: 0 in 1.103s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18affc7-0cd3-4472-8dfd-5fca97398d45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:13:57 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b86a3c2-6238-4848-a43b-de68663a69f1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:13:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:57 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62f15b5-19d9-439b-9751-98adce5748d0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:13:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:57 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1 Jul 09 14:13:57 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:57 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 Jul 09 14:13:57 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:58 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1" returned: 0 in 0.864s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:58 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365" returned: 0 in 0.890s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18affc7-0cd3-4472-8dfd-5fca97398d45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:13:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:58 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1 Jul 09 14:13:58 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:58 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7 Jul 09 14:13:58 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:59 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-935c2025-47aa-4451-b94d-3d8621ecb4c1" returned: 0 in 0.721s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Lock "cinder-quobyte-935c2025-47aa-4451-b94d-3d8621ecb4c1" released by "delete_volume" :: held 1.716s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:13:59 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Created reservations ['3cb3cd72-a840-4c2d-af40-5dfa0d58e566', '22367a70-f4c9-4745-9e1c-7efa7e6e84a6', 'a7fc6a9c-aa79-4980-b1bd-65396242c75b', '15504475-7164-4554-8bbc-b8f9e4220e89'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:13:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:13:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:13:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:13:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:13:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:13:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:59 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Jul 09 14:13:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7" returned: 0 in 0.863s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:13:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:13:59 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:13:59 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:13:59 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7 Jul 09 14:13:59 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:00 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.812s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:00 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:14:00 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Deleted volume successfully. Jul 09 14:14:00 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fff47554-814f-4270-b203-18991071275a tempest-VolumeSnapshotQuotasNegativeTestJSON-880297538 None] Lock "cinder-935c2025-47aa-4451-b94d-3d8621ecb4c1-delete_volume" released by "delete_volume" :: held 2.843s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:00 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.96c8a65a-30e5-4179-a200-3f4cd461b4d7" returned: 0 in 0.911s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:00 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-quobyte-96c8a65a-30e5-4179-a200-3f4cd461b4d7" released by "_delete_snapshot" :: held 3.914s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:00 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-quobyte-f18affc7-0cd3-4472-8dfd-5fca97398d45" released by "delete_snapshot" :: held 3.941s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:00 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] Created reservations ['92618a24-e7ed-44e7-90a0-f65bb03b1f66', '6c2cdeb8-f3b4-45e3-a530-d6f843073929', 'faca1ecd-2dd3-4821-b98b-4cd38570d0f6', 'e2c3f06a-3ace-42b0-abe0-9e541c7b727f'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:14:00 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] Delete snapshot completed successfully. Jul 09 14:14:00 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2a3fd5dc-360b-4243-b21e-404f2a6abea6 tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-96c8a65a-30e5-4179-a200-3f4cd461b4d7-delete_snapshot" released by "delete_snapshot" :: held 4.122s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a29182a9-f3d3-4817-a198-07f78bc19156 tempest-SnapshotsActionsTest-1268948013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a29182a9-f3d3-4817-a198-07f78bc19156 tempest-SnapshotsActionsTest-1268948013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-a29182a9-f3d3-4817-a198-07f78bc19156 tempest-SnapshotsActionsTest-1268948013 None] Creating offline snapshot a3d3442e-852c-4a28-ab02-0dda8a08da87 of volume f18affc7-0cd3-4472-8dfd-5fca97398d45 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:14:01 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e08ff3-1be1-42cf-bf44-6dd1a9e6f38a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:14:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a29182a9-f3d3-4817-a198-07f78bc19156 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:01 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 Jul 09 14:14:01 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:02 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a29182a9-f3d3-4817-a198-07f78bc19156 tempest-SnapshotsActionsTest-1268948013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365" returned: 0 in 1.167s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:02 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-a29182a9-f3d3-4817-a198-07f78bc19156 tempest-SnapshotsActionsTest-1268948013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18affc7-0cd3-4472-8dfd-5fca97398d45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:14:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a29182a9-f3d3-4817-a198-07f78bc19156 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:02 devstack sudo[94126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87 1G Jul 09 14:14:02 devstack sudo[94126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:03 devstack sudo[94126]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a29182a9-f3d3-4817-a198-07f78bc19156 tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87 1G" returned: 0 in 1.027s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a29182a9-f3d3-4817-a198-07f78bc19156 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:03 devstack sudo[94138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87 Jul 09 14:14:03 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:04 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a29182a9-f3d3-4817-a198-07f78bc19156 tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87" returned: 0 in 0.828s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:04 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-a29182a9-f3d3-4817-a198-07f78bc19156 tempest-SnapshotsActionsTest-1268948013 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87 is being set with open permissions: ugo+rw Jul 09 14:14:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a29182a9-f3d3-4817-a198-07f78bc19156 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:04 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87 Jul 09 14:14:04 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:04 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a29182a9-f3d3-4817-a198-07f78bc19156 tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87" returned: 0 in 0.714s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a29182a9-f3d3-4817-a198-07f78bc19156 tempest-SnapshotsActionsTest-1268948013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.871s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:04 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a29182a9-f3d3-4817-a198-07f78bc19156 tempest-SnapshotsActionsTest-1268948013 None] Create snapshot completed successfully Jul 09 14:14:05 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] Acquiring lock "cinder-a3d3442e-852c-4a28-ab02-0dda8a08da87-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:05 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-a3d3442e-852c-4a28-ab02-0dda8a08da87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:05 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] Acquiring lock "cinder-quobyte-f18affc7-0cd3-4472-8dfd-5fca97398d45" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:05 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-quobyte-f18affc7-0cd3-4472-8dfd-5fca97398d45" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:05 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] Acquiring lock "cinder-quobyte-a3d3442e-852c-4a28-ab02-0dda8a08da87" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:05 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-quobyte-a3d3442e-852c-4a28-ab02-0dda8a08da87" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] Deleting offline snapshot a3d3442e-852c-4a28-ab02-0dda8a08da87 of volume f18affc7-0cd3-4472-8dfd-5fca97398d45 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:14:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] snapshot_file for this snap is: volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:14:05 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b40cbf7-e9d0-4e8c-b59f-2c48fa0259da]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:14:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:05 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87 Jul 09 14:14:05 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:06 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87" returned: 0 in 0.956s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:06 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18affc7-0cd3-4472-8dfd-5fca97398d45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:14:06 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a2fb38b8-fd86-4737-8a52-c81204fe8480 tempest-GroupsTest-274592744 None] Group tempest-Group1-1777604108: creating Jul 09 14:14:06 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[83773eee-04a4-4e94-861e-53162ab0b0ca]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:14:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:06 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a2fb38b8-fd86-4737-8a52-c81204fe8480 tempest-GroupsTest-274592744 None] Group tempest-Group1-1777604108: created successfully Jul 09 14:14:06 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a2fb38b8-fd86-4737-8a52-c81204fe8480 tempest-GroupsTest-274592744 None] Create group completed successfully. Jul 09 14:14:06 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 Jul 09 14:14:06 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:07 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365" returned: 0 in 0.993s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18affc7-0cd3-4472-8dfd-5fca97398d45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:14:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:07 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87 Jul 09 14:14:07 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:07 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ed5bb773-298c-438b-8321-3534c92ebcf2 tempest-GroupsTest-274592744 None] Group tempest-Group2-935205768: creating Jul 09 14:14:07 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ed5bb773-298c-438b-8321-3534c92ebcf2 tempest-GroupsTest-274592744 None] Group tempest-Group2-935205768: created successfully Jul 09 14:14:07 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ed5bb773-298c-438b-8321-3534c92ebcf2 tempest-GroupsTest-274592744 None] Create group completed successfully. Jul 09 14:14:08 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87" returned: 0 in 1.022s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:08 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87 Jul 09 14:14:08 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:09 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.a3d3442e-852c-4a28-ab02-0dda8a08da87" returned: 0 in 0.792s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-quobyte-a3d3442e-852c-4a28-ab02-0dda8a08da87" released by "_delete_snapshot" :: held 4.007s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-quobyte-f18affc7-0cd3-4472-8dfd-5fca97398d45" released by "delete_snapshot" :: held 4.042s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] Created reservations ['e1a85424-b9ae-404c-ab01-e01ed0000177', '37fb9583-b34f-41fd-8ed8-9ea53b817602', '5531258c-c60e-4437-bd73-5f9ff330e4bd', 'd3ec0be0-00ef-4f29-9d09-8afd78630fac'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:14:09 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] Delete snapshot completed successfully. Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bc784d34-2c35-4f70-b355-fce4394407ec tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-a3d3442e-852c-4a28-ab02-0dda8a08da87-delete_snapshot" released by "delete_snapshot" :: held 4.347s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Flow 'volume_create_manager' (51e7bc53-9d91-49c0-884e-9a94556b33ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0945bab8-80cb-4314-8aa4-85867a8648f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0945bab8-80cb-4314-8aa4-85867a8648f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-625861945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea726078-17c7-4410-bacc-0f505c92d0ee,host='devstack@QuobyteHD#QuobyteHD',id=7d5362c7-05bf-4663-a721-8c595d41a91d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f8918d431b4b5ca522f7999c4d64cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:14:10Z,use_quota=True,user_id='379d9b1bbc274cb08cc1f2c643473bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4f2cc56-0182-40d2-9061-721548ed2e30),volume_type_id=c4f2cc56-0182-40d2-9061-721548ed2e30)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad91ad2-c799-43c7-b9e8-8e81f4385e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad91ad2-c799-43c7-b9e8-8e81f4385e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de579f9b-1cd7-42fb-b13f-3d7446fe4a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de579f9b-1cd7-42fb-b13f-3d7446fe4a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d5362c7-05bf-4663-a721-8c595d41a91d', 'volume_name': 'volume-7d5362c7-05bf-4663-a721-8c595d41a91d', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b6ce36-ba0f-4968-aa58-fc8579ecab27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b6ce36-ba0f-4968-aa58-fc8579ecab27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eddfb08-2048-4127-9085-da6e9ca65f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:09 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Volume 7d5362c7-05bf-4663-a721-8c595d41a91d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d5362c7-05bf-4663-a721-8c595d41a91d', 'volume_size': 1} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ea726078-17c7-4410-bacc-0f505c92d0ee,created_at=2026-07-09T12:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-625861945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea726078-17c7-4410-bacc-0f505c92d0ee,host='devstack@QuobyteHD#QuobyteHD',id=7d5362c7-05bf-4663-a721-8c595d41a91d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f8918d431b4b5ca522f7999c4d64cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:14:10Z,use_quota=True,user_id='379d9b1bbc274cb08cc1f2c643473bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4f2cc56-0182-40d2-9061-721548ed2e30),volume_type_id=c4f2cc56-0182-40d2-9061-721548ed2e30)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Creating volume 7d5362c7-05bf-4663-a721-8c595d41a91d {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:14:09 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:14:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d5362c7-05bf-4663-a721-8c595d41a91d 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:09 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d5362c7-05bf-4663-a721-8c595d41a91d 1073741824 Jul 09 14:14:09 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:11 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d5362c7-05bf-4663-a721-8c595d41a91d 1073741824" returned: 0 in 1.158s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d5362c7-05bf-4663-a721-8c595d41a91d {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:11 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d5362c7-05bf-4663-a721-8c595d41a91d Jul 09 14:14:11 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-939e0548-fe59-4712-8a05-cefc56bdc7c9 tempest-SnapshotsActionsTest-1268948013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:12 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d5362c7-05bf-4663-a721-8c595d41a91d" returned: 0 in 1.237s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] <== create_volume: return (2472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:14:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.476s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-939e0548-fe59-4712-8a05-cefc56bdc7c9 tempest-SnapshotsActionsTest-1268948013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.141s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-939e0548-fe59-4712-8a05-cefc56bdc7c9 tempest-SnapshotsActionsTest-1268948013 None] Creating offline snapshot ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6 of volume f18affc7-0cd3-4472-8dfd-5fca97398d45 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:14:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eddfb08-2048-4127-9085-da6e9ca65f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d5362c7-05bf-4663-a721-8c595d41a91d', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e8d76a-60ef-4c32-97a5-4557ddd7647f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:12 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f745fd1-f477-4538-b2bf-0e9e1dc28f3c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:14:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-939e0548-fe59-4712-8a05-cefc56bdc7c9 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:12 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Volume volume-7d5362c7-05bf-4663-a721-8c595d41a91d (7d5362c7-05bf-4663-a721-8c595d41a91d): created successfully Jul 09 14:14:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e8d76a-60ef-4c32-97a5-4557ddd7647f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Flow 'volume_create_manager' (51e7bc53-9d91-49c0-884e-9a94556b33ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:14:12 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-8674a6f2-2529-46f7-8c68-4b57543274aa tempest-GroupsTest-274592744 None] Created volume successfully. Jul 09 14:14:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:14:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:14:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:14:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:12 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:14:12 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:12 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 Jul 09 14:14:12 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:13 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.054s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:14:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:14:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 8 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:14:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:14:13 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-939e0548-fe59-4712-8a05-cefc56bdc7c9 tempest-SnapshotsActionsTest-1268948013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365" returned: 0 in 1.294s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:13 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-939e0548-fe59-4712-8a05-cefc56bdc7c9 tempest-SnapshotsActionsTest-1268948013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18affc7-0cd3-4472-8dfd-5fca97398d45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:14:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-939e0548-fe59-4712-8a05-cefc56bdc7c9 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:13 devstack sudo[94259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6 1G Jul 09 14:14:13 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] Acquiring lock "cinder-quobyte-7d5362c7-05bf-4663-a721-8c595d41a91d" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] Lock "cinder-quobyte-7d5362c7-05bf-4663-a721-8c595d41a91d" acquired by "delete_volume" :: waited 0.043s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:14 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7ac007-c3ad-418a-bc22-e48095697ccb]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:14:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d5362c7-05bf-4663-a721-8c595d41a91d {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:14 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d5362c7-05bf-4663-a721-8c595d41a91d Jul 09 14:14:14 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:15 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-939e0548-fe59-4712-8a05-cefc56bdc7c9 tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6 1G" returned: 0 in 1.423s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-939e0548-fe59-4712-8a05-cefc56bdc7c9 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:15 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6 Jul 09 14:14:15 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:15 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d5362c7-05bf-4663-a721-8c595d41a91d" returned: 0 in 1.280s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d5362c7-05bf-4663-a721-8c595d41a91d {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:15 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d5362c7-05bf-4663-a721-8c595d41a91d Jul 09 14:14:15 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:16 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-939e0548-fe59-4712-8a05-cefc56bdc7c9 tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6" returned: 0 in 1.053s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:16 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-939e0548-fe59-4712-8a05-cefc56bdc7c9 tempest-SnapshotsActionsTest-1268948013 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6 is being set with open permissions: ugo+rw Jul 09 14:14:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-939e0548-fe59-4712-8a05-cefc56bdc7c9 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:16 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6 Jul 09 14:14:16 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:16 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d5362c7-05bf-4663-a721-8c595d41a91d" returned: 0 in 0.897s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] Lock "cinder-quobyte-7d5362c7-05bf-4663-a721-8c595d41a91d" released by "delete_volume" :: held 2.263s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:16 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] Created reservations ['c65a8adf-67cf-4b17-a5a1-e37898da58a0'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:14:16 devstack cinder-volume[87011]: WARNING cinder.quota [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1578144210 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1578144210, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:14:16 devstack cinder-volume[87011]: WARNING cinder.quota [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1578144210 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1578144210, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:14:16 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] Created reservations ['282bda66-248c-47b3-b17b-d5ca149b2a11', '4c9722eb-9f95-4bd9-8ac6-eaf07b388c25', '07cb2ce6-bee9-472a-8050-4979e77cf126', 'defe26a8-57f5-45c8-ba52-eee3ee55da0d'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:17 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:14:17 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:17 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-939e0548-fe59-4712-8a05-cefc56bdc7c9 tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6" returned: 0 in 0.987s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-939e0548-fe59-4712-8a05-cefc56bdc7c9 tempest-SnapshotsActionsTest-1268948013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.930s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:17 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-939e0548-fe59-4712-8a05-cefc56bdc7c9 tempest-SnapshotsActionsTest-1268948013 None] Create snapshot completed successfully Jul 09 14:14:17 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] Acquiring lock "cinder-ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.788s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:14:17 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-72101ab1-0908-4a68-a007-33b4f12f6776 tempest-GroupsTest-274592744 None] Delete group completed successfully. Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] Acquiring lock "cinder-quobyte-f18affc7-0cd3-4472-8dfd-5fca97398d45" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-quobyte-f18affc7-0cd3-4472-8dfd-5fca97398d45" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] Acquiring lock "cinder-quobyte-ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-quobyte-ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] Deleting offline snapshot ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6 of volume f18affc7-0cd3-4472-8dfd-5fca97398d45 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] snapshot_file for this snap is: volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d63b62d-84d0-4443-b574-e75dcd19320c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:14:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:18 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6 Jul 09 14:14:18 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:18 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-0c832fad-4cfe-4510-b1c3-e2f5e027efb5 tempest-GroupsTest-274592744 None] Created reservations ['03b76161-0a54-4a29-a757-9ea6647bf4c5'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:14:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0c832fad-4cfe-4510-b1c3-e2f5e027efb5 tempest-GroupsTest-274592744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0c832fad-4cfe-4510-b1c3-e2f5e027efb5 tempest-GroupsTest-274592744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0c832fad-4cfe-4510-b1c3-e2f5e027efb5 tempest-GroupsTest-274592744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:14:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0c832fad-4cfe-4510-b1c3-e2f5e027efb5 tempest-GroupsTest-274592744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:14:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0c832fad-4cfe-4510-b1c3-e2f5e027efb5 tempest-GroupsTest-274592744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0c832fad-4cfe-4510-b1c3-e2f5e027efb5 tempest-GroupsTest-274592744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:18 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:14:18 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:18 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6" returned: 0 in 0.985s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18affc7-0cd3-4472-8dfd-5fca97398d45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:14:19 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcec2a7-ff84-4577-83a1-ee7b08642c11]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:14:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:19 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 Jul 09 14:14:19 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:19 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0c832fad-4cfe-4510-b1c3-e2f5e027efb5 tempest-GroupsTest-274592744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.242s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:19 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-0c832fad-4cfe-4510-b1c3-e2f5e027efb5 tempest-GroupsTest-274592744 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:14:19 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-0c832fad-4cfe-4510-b1c3-e2f5e027efb5 tempest-GroupsTest-274592744 None] Delete group completed successfully. Jul 09 14:14:20 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365" returned: 0 in 1.113s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18affc7-0cd3-4472-8dfd-5fca97398d45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:14:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:20 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6 Jul 09 14:14:20 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:20 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-bb5d071e-4897-4820-9cc2-152fbb8012c3 tempest-GroupsTest-274592744 None] Group tempest-GroupsTest-Group-17024729: creating Jul 09 14:14:20 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-bb5d071e-4897-4820-9cc2-152fbb8012c3 tempest-GroupsTest-274592744 None] Group tempest-GroupsTest-Group-17024729: created successfully Jul 09 14:14:20 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-bb5d071e-4897-4820-9cc2-152fbb8012c3 tempest-GroupsTest-274592744 None] Create group completed successfully. Jul 09 14:14:21 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6" returned: 0 in 0.890s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:21 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6 Jul 09 14:14:21 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:21 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6" returned: 0 in 0.862s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-quobyte-ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6" released by "_delete_snapshot" :: held 3.976s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-quobyte-f18affc7-0cd3-4472-8dfd-5fca97398d45" released by "delete_snapshot" :: held 4.001s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] Created reservations ['1a13c3ee-efa9-42a3-9b6a-5f89c8dd9d7d', '8b3fcb90-e3ba-4d7b-93cf-261210989da2', '3d74940e-e7c8-4a43-89d1-d537ef49ca47', '8d6cda7c-a2ec-40b4-ab26-8991f2b2cdd6'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:14:22 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] Delete snapshot completed successfully. Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6a4e1440-5fa0-48a6-8634-687df5e4e5e1 tempest-SnapshotsActionsTest-1644631492 None] Lock "cinder-ef07f1d6-60f2-4b3e-8b40-ef18cd5391e6-delete_snapshot" released by "delete_snapshot" :: held 4.189s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Flow 'volume_create_manager' (9d58b2a0-9406-4934-9a7d-0e2da2e08b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5b7fe1-3243-4357-84b0-c318c42aad0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5b7fe1-3243-4357-84b0-c318c42aad0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1828595425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3bd4effd-134d-4da1-8bf6-9915a2a20992,host='devstack@QuobyteHD#QuobyteHD',id=e5d3eeb8-256d-4ff6-be7e-250e55e072e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f8918d431b4b5ca522f7999c4d64cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:14:22Z,use_quota=True,user_id='379d9b1bbc274cb08cc1f2c643473bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(977b6c73-d17e-4919-ad12-c2e890258a59),volume_type_id=977b6c73-d17e-4919-ad12-c2e890258a59)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c55392b-7eb8-4f44-bb5d-1230f021271c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c55392b-7eb8-4f44-bb5d-1230f021271c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c266b54a-3d38-48db-8d4b-e221d800fd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c266b54a-3d38-48db-8d4b-e221d800fd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5d3eeb8-256d-4ff6-be7e-250e55e072e9', 'volume_name': 'volume-e5d3eeb8-256d-4ff6-be7e-250e55e072e9', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42de3f20-1f55-4fb9-a48b-1d9d7e7142bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42de3f20-1f55-4fb9-a48b-1d9d7e7142bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78d21e6-ef21-4d30-be25-47b3df6dbc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:22 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Volume e5d3eeb8-256d-4ff6-be7e-250e55e072e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5d3eeb8-256d-4ff6-be7e-250e55e072e9', 'volume_size': 1} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3bd4effd-134d-4da1-8bf6-9915a2a20992,created_at=2026-07-09T12:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1828595425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3bd4effd-134d-4da1-8bf6-9915a2a20992,host='devstack@QuobyteHD#QuobyteHD',id=e5d3eeb8-256d-4ff6-be7e-250e55e072e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f8918d431b4b5ca522f7999c4d64cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:14:22Z,use_quota=True,user_id='379d9b1bbc274cb08cc1f2c643473bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(977b6c73-d17e-4919-ad12-c2e890258a59),volume_type_id=977b6c73-d17e-4919-ad12-c2e890258a59)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Creating volume e5d3eeb8-256d-4ff6-be7e-250e55e072e9 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:14:22 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e5d3eeb8-256d-4ff6-be7e-250e55e072e9 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:22 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e5d3eeb8-256d-4ff6-be7e-250e55e072e9 1073741824 Jul 09 14:14:22 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] Acquiring lock "cinder-8922a185-57ed-4564-b255-b0e5b549a365-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] Lock "cinder-8922a185-57ed-4564-b255-b0e5b549a365-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] Acquiring lock "cinder-quobyte-f18affc7-0cd3-4472-8dfd-5fca97398d45" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] Lock "cinder-quobyte-f18affc7-0cd3-4472-8dfd-5fca97398d45" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] Acquiring lock "cinder-quobyte-8922a185-57ed-4564-b255-b0e5b549a365" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] Lock "cinder-quobyte-8922a185-57ed-4564-b255-b0e5b549a365" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] Deleting offline snapshot 8922a185-57ed-4564-b255-b0e5b549a365 of volume f18affc7-0cd3-4472-8dfd-5fca97398d45 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] snapshot_file for this snap is: volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8eb38d-e110-4f0d-9a6b-4faca17d98b6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:14:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:22 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 Jul 09 14:14:22 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:23 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e5d3eeb8-256d-4ff6-be7e-250e55e072e9 1073741824" returned: 0 in 0.866s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e5d3eeb8-256d-4ff6-be7e-250e55e072e9 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:23 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e5d3eeb8-256d-4ff6-be7e-250e55e072e9 Jul 09 14:14:23 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:23 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365" returned: 0 in 0.888s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18affc7-0cd3-4472-8dfd-5fca97398d45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:14:23 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[be19ef51-9f63-4af7-95bb-144899c1f210]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:14:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:23 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45 Jul 09 14:14:23 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:24 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e5d3eeb8-256d-4ff6-be7e-250e55e072e9" returned: 0 in 0.727s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:14:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78d21e6-ef21-4d30-be25-47b3df6dbc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5d3eeb8-256d-4ff6-be7e-250e55e072e9', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012e0c43-1eff-4ef1-8151-8e534f6c74ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:24 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Volume volume-e5d3eeb8-256d-4ff6-be7e-250e55e072e9 (e5d3eeb8-256d-4ff6-be7e-250e55e072e9): created successfully Jul 09 14:14:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012e0c43-1eff-4ef1-8151-8e534f6c74ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Flow 'volume_create_manager' (9d58b2a0-9406-4934-9a7d-0e2da2e08b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:14:24 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-cbec9417-8145-47a7-9f62-887daa006b8e tempest-GroupsTest-274592744 None] Created volume successfully. Jul 09 14:14:24 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45" returned: 0 in 0.791s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:24 devstack sudo[94348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 Jul 09 14:14:24 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Flow 'volume_create_manager' (9a5bc423-f921-4535-9ec2-baf55be6029e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:14:25 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3170b24-bb23-43a3-ac2a-8a787f400386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365" returned: 0 in 0.879s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3170b24-bb23-43a3-ac2a-8a787f400386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-734970384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3bd4effd-134d-4da1-8bf6-9915a2a20992,host='devstack@QuobyteHD#QuobyteHD',id=5ac69ac5-d8cf-412e-8f83-ef80590ea944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f8918d431b4b5ca522f7999c4d64cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:14:25Z,use_quota=True,user_id='379d9b1bbc274cb08cc1f2c643473bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(977b6c73-d17e-4919-ad12-c2e890258a59),volume_type_id=977b6c73-d17e-4919-ad12-c2e890258a59)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d504acb5-762d-4532-aea8-609e0eeb4694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:25 devstack sudo[94353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365 Jul 09 14:14:25 devstack sudo[94353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d504acb5-762d-4532-aea8-609e0eeb4694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f0587f-1cc6-4e62-ae98-fd587003625b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48f0587f-1cc6-4e62-ae98-fd587003625b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ac69ac5-d8cf-412e-8f83-ef80590ea944', 'volume_name': 'volume-5ac69ac5-d8cf-412e-8f83-ef80590ea944', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db23ace-5291-44ae-b0ee-cda769ffde83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db23ace-5291-44ae-b0ee-cda769ffde83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb2ce93-183a-4ddc-ba40-c38437ede44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:25 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Volume 5ac69ac5-d8cf-412e-8f83-ef80590ea944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ac69ac5-d8cf-412e-8f83-ef80590ea944', 'volume_size': 1} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3bd4effd-134d-4da1-8bf6-9915a2a20992,created_at=2026-07-09T12:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-734970384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3bd4effd-134d-4da1-8bf6-9915a2a20992,host='devstack@QuobyteHD#QuobyteHD',id=5ac69ac5-d8cf-412e-8f83-ef80590ea944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f8918d431b4b5ca522f7999c4d64cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:14:25Z,use_quota=True,user_id='379d9b1bbc274cb08cc1f2c643473bb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(977b6c73-d17e-4919-ad12-c2e890258a59),volume_type_id=977b6c73-d17e-4919-ad12-c2e890258a59)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Creating volume 5ac69ac5-d8cf-412e-8f83-ef80590ea944 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:14:25 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:14:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5ac69ac5-d8cf-412e-8f83-ef80590ea944 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:25 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5ac69ac5-d8cf-412e-8f83-ef80590ea944 1073741824 Jul 09 14:14:25 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:26 devstack sudo[94353]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45.8922a185-57ed-4564-b255-b0e5b549a365" returned: 0 in 0.803s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] Lock "cinder-quobyte-8922a185-57ed-4564-b255-b0e5b549a365" released by "_delete_snapshot" :: held 3.509s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] Lock "cinder-quobyte-f18affc7-0cd3-4472-8dfd-5fca97398d45" released by "delete_snapshot" :: held 3.536s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:26 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] Created reservations ['1bbd2c06-63de-4f12-9db1-bb63e18885a0', 'fad2f5fe-3c36-479c-94f6-d8714f72d30c', '79571844-3d48-4e8e-89e0-c8cf2757718e', '261d333c-2b96-4635-8701-64032b4c7f98'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:14:26 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] Delete snapshot completed successfully. Jul 09 14:14:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c5bdaea8-f3e4-41b2-8b3b-6c9bd9185cb2 tempest-SnapshotsActionsTest-1268948013 None] Lock "cinder-8922a185-57ed-4564-b255-b0e5b549a365-delete_snapshot" released by "delete_snapshot" :: held 3.704s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:26 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5ac69ac5-d8cf-412e-8f83-ef80590ea944 1073741824" returned: 0 in 1.011s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5ac69ac5-d8cf-412e-8f83-ef80590ea944 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:26 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5ac69ac5-d8cf-412e-8f83-ef80590ea944 Jul 09 14:14:26 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] Acquiring lock "cinder-f18affc7-0cd3-4472-8dfd-5fca97398d45-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] Lock "cinder-f18affc7-0cd3-4472-8dfd-5fca97398d45-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] Acquiring lock "cinder-quobyte-f18affc7-0cd3-4472-8dfd-5fca97398d45" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] Lock "cinder-quobyte-f18affc7-0cd3-4472-8dfd-5fca97398d45" acquired by "delete_volume" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:27 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b29aac-2057-41f7-93f3-d63c946ea9f8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:14:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:27 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5ac69ac5-d8cf-412e-8f83-ef80590ea944" returned: 0 in 0.845s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:27 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:14:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb2ce93-183a-4ddc-ba40-c38437ede44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ac69ac5-d8cf-412e-8f83-ef80590ea944', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8bced7-76aa-404e-8f34-35a530efda2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:27 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Volume volume-5ac69ac5-d8cf-412e-8f83-ef80590ea944 (5ac69ac5-d8cf-412e-8f83-ef80590ea944): created successfully Jul 09 14:14:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8bced7-76aa-404e-8f34-35a530efda2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Flow 'volume_create_manager' (9a5bc423-f921-4535-9ec2-baf55be6029e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:14:27 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45 Jul 09 14:14:27 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:27 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-1944ee0b-1048-4d4e-b56b-05620ae09d63 tempest-GroupsTest-274592744 None] Created volume successfully. Jul 09 14:14:28 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-3fec096b-4952-48eb-828c-3f85669c3cc3 tempest-GroupsTest-274592744 None] Update group completed successfully. Jul 09 14:14:28 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45" returned: 0 in 1.086s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:28 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45 Jul 09 14:14:28 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:29 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f18affc7-0cd3-4472-8dfd-5fca97398d45" returned: 0 in 0.970s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] Lock "cinder-quobyte-f18affc7-0cd3-4472-8dfd-5fca97398d45" released by "delete_volume" :: held 2.152s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:29 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=85,cinder:SELECT=89,cinder:DELETE=6,cinder:INSERT=21 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:14:29 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=86,cinder:INSERT=24,cinder:UPDATE=91,cinder:DELETE=7 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:14:29 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] Created reservations ['52feea3a-7c3d-4ef0-9c2c-6293d3751fb5', 'ec95ef2c-bef9-4ee7-9766-f7f5c6289ae3', '5d73f209-0a80-404a-a2dd-81b57e5380cc', '46d9033c-261c-40dd-b815-b957c6b29b87'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:14:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:14:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:14:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:29 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:14:29 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:29 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-e85fa7d5-72aa-44fb-ad8d-b8c6eb777aec tempest-GroupsTest-274592744 None] Update group completed successfully. Jul 09 14:14:30 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.880s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:30 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:14:30 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] Deleted volume successfully. Jul 09 14:14:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad649c5f-65f5-4928-ad17-8e60105379a1 tempest-SnapshotsActionsTest-1268948013 None] Lock "cinder-f18affc7-0cd3-4472-8dfd-5fca97398d45-delete_volume" released by "delete_volume" :: held 3.309s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Acquiring lock "cinder-quobyte-5ac69ac5-d8cf-412e-8f83-ef80590ea944" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Lock "cinder-quobyte-5ac69ac5-d8cf-412e-8f83-ef80590ea944" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:31 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8470765-2d6f-49a2-9293-7818e59f7258]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:14:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5ac69ac5-d8cf-412e-8f83-ef80590ea944 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:31 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5ac69ac5-d8cf-412e-8f83-ef80590ea944 Jul 09 14:14:31 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:32 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5ac69ac5-d8cf-412e-8f83-ef80590ea944" returned: 0 in 0.937s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5ac69ac5-d8cf-412e-8f83-ef80590ea944 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:32 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5ac69ac5-d8cf-412e-8f83-ef80590ea944 Jul 09 14:14:32 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:33 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5ac69ac5-d8cf-412e-8f83-ef80590ea944" returned: 0 in 0.777s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Lock "cinder-quobyte-5ac69ac5-d8cf-412e-8f83-ef80590ea944" released by "delete_volume" :: held 1.773s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Acquiring lock "cinder-quobyte-e5d3eeb8-256d-4ff6-be7e-250e55e072e9" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Lock "cinder-quobyte-e5d3eeb8-256d-4ff6-be7e-250e55e072e9" acquired by "delete_volume" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:33 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cd4e5c-0817-41cf-a971-0e092bf67583]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:14:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e5d3eeb8-256d-4ff6-be7e-250e55e072e9 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:33 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e5d3eeb8-256d-4ff6-be7e-250e55e072e9 Jul 09 14:14:33 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:34 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e5d3eeb8-256d-4ff6-be7e-250e55e072e9" returned: 0 in 0.919s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e5d3eeb8-256d-4ff6-be7e-250e55e072e9 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:34 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e5d3eeb8-256d-4ff6-be7e-250e55e072e9 Jul 09 14:14:34 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Flow 'volume_create_manager' (58d9b6c3-5e56-4ff9-b27c-0da443987b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e54fafe9-35e7-4339-9640-103f8ed88d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e54fafe9-35e7-4339-9640-103f8ed88d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1281673374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0465182-26e4-47d9-9bf8-ed3f5282de9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7de023e075a4cbfa155ec1f9e6ee967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:14:34Z,use_quota=True,user_id='9543c74ad968468b85af39b9df39b3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a34aed3-d29f-41fa-907b-9f12b7fe33b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a34aed3-d29f-41fa-907b-9f12b7fe33b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c204aad-e9ea-401b-87ba-bf06a20e4c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c204aad-e9ea-401b-87ba-bf06a20e4c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0465182-26e4-47d9-9bf8-ed3f5282de9f', 'volume_name': 'volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377fa761-0dcb-429c-8460-862ad6678a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377fa761-0dcb-429c-8460-862ad6678a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2ac509-1ec9-41bd-b189-cecf21af9e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:34 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Volume c0465182-26e4-47d9-9bf8-ed3f5282de9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f', 'volume_size': 1} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1281673374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0465182-26e4-47d9-9bf8-ed3f5282de9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7de023e075a4cbfa155ec1f9e6ee967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:14:34Z,use_quota=True,user_id='9543c74ad968468b85af39b9df39b3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Creating volume c0465182-26e4-47d9-9bf8-ed3f5282de9f {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:14:34 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:34 devstack sudo[94405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f 1073741824 Jul 09 14:14:34 devstack sudo[94405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:34 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e5d3eeb8-256d-4ff6-be7e-250e55e072e9" returned: 0 in 0.793s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Lock "cinder-quobyte-e5d3eeb8-256d-4ff6-be7e-250e55e072e9" released by "delete_volume" :: held 1.756s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:35 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Created reservations ['6a1bc2e7-b75b-49ca-87dc-c4ae8813a2f0'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:14:35 devstack cinder-volume[87011]: WARNING cinder.quota [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-944322510 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-944322510, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:14:35 devstack cinder-volume[87011]: WARNING cinder.quota [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-944322510 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-944322510, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:14:35 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Created reservations ['ef24140e-c79f-42ef-981a-3278e30d613d', 'c085bbd4-ca77-47c5-80b0-99f6cba0ea41', 'df08d3df-8bf5-4417-b555-65fc923107d5', '85238e2d-9415-4079-b32e-92029ece0c01'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:14:35 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Created reservations ['e6d7b4bc-674a-4d2a-bc70-5d043648084d', '0d018e07-c5a1-4069-8c97-b43fd892515f', '473cc407-aab4-4de6-ab15-b5ccf086e55e', 'bc7a9c77-53f8-4042-9c08-50cfdbb3147f'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:14:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:14:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:14:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:35 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:14:35 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:35 devstack sudo[94405]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f 1073741824" returned: 0 in 1.111s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:35 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f Jul 09 14:14:35 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:36 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.772s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:36 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:14:36 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-458e2067-2db0-400a-87c7-93ca2270a4a1 tempest-GroupsTest-274592744 None] Delete group completed successfully. Jul 09 14:14:36 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f" returned: 0 in 0.672s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:14:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2ac509-1ec9-41bd-b189-cecf21af9e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fab423f-1b00-4da2-ab0c-1b8b1e81786a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:36 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Volume volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f (c0465182-26e4-47d9-9bf8-ed3f5282de9f): created successfully Jul 09 14:14:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fab423f-1b00-4da2-ab0c-1b8b1e81786a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Flow 'volume_create_manager' (58d9b6c3-5e56-4ff9-b27c-0da443987b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:14:36 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-8ec67179-df17-4a2e-9a6c-880fa08fa739 tempest-AttachVolumeTestJSON-1739532221 None] Created volume successfully. Jul 09 14:14:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-8242b052-f086-42d1-9628-66953677b9a4 req-3c9403b8-fd70-4a0a-b007-c700749375b5 tempest-AttachVolumeTestJSON-1739532221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-8242b052-f086-42d1-9628-66953677b9a4 req-3c9403b8-fd70-4a0a-b007-c700749375b5 tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:41 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e0c17c-133c-49c8-b308-95f10d7de7f7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:14:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-8242b052-f086-42d1-9628-66953677b9a4 req-3c9403b8-fd70-4a0a-b007-c700749375b5 tempest-AttachVolumeTestJSON-1739532221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:41 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f Jul 09 14:14:41 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:42 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-8242b052-f086-42d1-9628-66953677b9a4 req-3c9403b8-fd70-4a0a-b007-c700749375b5 tempest-AttachVolumeTestJSON-1739532221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f" returned: 0 in 0.916s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-8242b052-f086-42d1-9628-66953677b9a4 req-3c9403b8-fd70-4a0a-b007-c700749375b5 tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.935s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-8242b052-f086-42d1-9628-66953677b9a4 req-3c9403b8-fd70-4a0a-b007-c700749375b5 tempest-AttachVolumeTestJSON-1739532221 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b5480c0-4070-4c63-be43-d86e48b4b6ab', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:14:42 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-8242b052-f086-42d1-9628-66953677b9a4 req-3c9403b8-fd70-4a0a-b007-c700749375b5 tempest-AttachVolumeTestJSON-1739532221 None] attachment_update completed successfully. Jul 09 14:14:43 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-34727d36-661a-4708-8b42-202649e25486 tempest-GroupsV314Test-1660977482 None] Group tempest-GroupsV314Test-Group-1401190185: creating Jul 09 14:14:43 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-34727d36-661a-4708-8b42-202649e25486 tempest-GroupsV314Test-1660977482 None] Group tempest-GroupsV314Test-Group-1401190185: created successfully Jul 09 14:14:43 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-34727d36-661a-4708-8b42-202649e25486 tempest-GroupsV314Test-1660977482 None] Create group completed successfully. Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Flow 'volume_create_manager' (6e7fd32c-791a-471b-bd52-441a7046b820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63143348-4493-4610-8ca5-28c43a9d82d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63143348-4493-4610-8ca5-28c43a9d82d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-961650900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5287caa2e8c4f30b7727f3bb4074ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:14:44Z,use_quota=True,user_id='a57e453f18544bd0ad83d78077c3cf5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b139d18-f46f-4819-ae3a-a47fafb16bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b139d18-f46f-4819-ae3a-a47fafb16bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8bad38-9975-45c4-9931-3945529cbf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8bad38-9975-45c4-9931-3945529cbf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7', 'volume_name': 'volume-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f855ee-0857-4463-9182-fa59e71a4b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f855ee-0857-4463-9182-fa59e71a4b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebce3c1-1fe0-4b65-8e4b-9d4360b3f583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:44 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Volume bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7', 'volume_size': 1} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-961650900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5287caa2e8c4f30b7727f3bb4074ee2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:14:44Z,use_quota=True,user_id='a57e453f18544bd0ad83d78077c3cf5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Creating volume bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:14:44 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:14:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:44 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7 1073741824 Jul 09 14:14:44 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:45 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7 1073741824" returned: 0 in 0.924s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:45 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7 Jul 09 14:14:45 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Flow 'volume_create_manager' (b5e56235-622d-41c4-9d13-0b1c5693989e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d38a54-8ef1-4e93-a75c-aef6bfbb6de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d38a54-8ef1-4e93-a75c-aef6bfbb6de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2100796739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e95ef61-5641-4e3e-bf03-854fd650302e,host='devstack@QuobyteHD#QuobyteHD',id=32f46ae0-c190-4c46-bb4f-01c6bbc85a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1371e64727c4421bae2dc8779ad1a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:14:45Z,use_quota=True,user_id='95a2f314fe674af9b461a40bcebddd6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f4568c3-17fc-4706-8bb9-ffd5d35542b8),volume_type_id=7f4568c3-17fc-4706-8bb9-ffd5d35542b8)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9154c54e-1334-4d4c-b62c-9d564149ceb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9154c54e-1334-4d4c-b62c-9d564149ceb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ccfafdb-4b73-4f9e-a648-a43fa17d6062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ccfafdb-4b73-4f9e-a648-a43fa17d6062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32f46ae0-c190-4c46-bb4f-01c6bbc85a31', 'volume_name': 'volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a49b91-f6ce-445d-88de-364441591583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a49b91-f6ce-445d-88de-364441591583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c04923-8f4f-4615-95cd-5370f19510e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:45 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Volume 32f46ae0-c190-4c46-bb4f-01c6bbc85a31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31', 'volume_size': 1} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:45 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7" returned: 0 in 0.770s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.341s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8e95ef61-5641-4e3e-bf03-854fd650302e,created_at=2026-07-09T12:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2100796739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e95ef61-5641-4e3e-bf03-854fd650302e,host='devstack@QuobyteHD#QuobyteHD',id=32f46ae0-c190-4c46-bb4f-01c6bbc85a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1371e64727c4421bae2dc8779ad1a4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:14:45Z,use_quota=True,user_id='95a2f314fe674af9b461a40bcebddd6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f4568c3-17fc-4706-8bb9-ffd5d35542b8),volume_type_id=7f4568c3-17fc-4706-8bb9-ffd5d35542b8)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Creating volume 32f46ae0-c190-4c46-bb4f-01c6bbc85a31 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:14:45 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:45 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 1073741824 Jul 09 14:14:45 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ebce3c1-1fe0-4b65-8e4b-9d4360b3f583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8bde51e-7f86-44ab-99f3-296089db0049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:45 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Volume volume-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7 (bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7): created successfully Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8bde51e-7f86-44ab-99f3-296089db0049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Flow 'volume_create_manager' (6e7fd32c-791a-471b-bd52-441a7046b820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:14:45 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-dba8884e-76a4-4db1-8702-7212e6728b98 tempest-VolumeQuotasNegativeTestJSON-603914037 None] Created volume successfully. Jul 09 14:14:46 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 1073741824" returned: 0 in 0.928s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:46 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 Jul 09 14:14:46 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:47 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31" returned: 0 in 0.989s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:14:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c04923-8f4f-4615-95cd-5370f19510e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa6125a-f71b-4e53-974f-05e9e912c513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:47 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Volume volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 (32f46ae0-c190-4c46-bb4f-01c6bbc85a31): created successfully Jul 09 14:14:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa6125a-f71b-4e53-974f-05e9e912c513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Flow 'volume_create_manager' (b5e56235-622d-41c4-9d13-0b1c5693989e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:14:47 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-f160413b-b404-4d58-8a87-b28a3a9c1e29 tempest-GroupsV314Test-1660977482 None] Created volume successfully. Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Flow 'volume_create_manager' (d25065a1-e30f-44c9-96fb-1cad0221b829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c67e94-79d3-43c6-afdf-1b1129d04270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c67e94-79d3-43c6-afdf-1b1129d04270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-662400385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc626525-42a7-4364-a207-81b403904380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172b9469f79c4fd29fcf1c606389089f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:14:48Z,use_quota=True,user_id='c257d722ac994c7783cc55329e715575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8522a89-022c-4273-8fd1-991d3496e751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8522a89-022c-4273-8fd1-991d3496e751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8862d47-748a-4ed3-8644-582bd2f91eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8862d47-748a-4ed3-8644-582bd2f91eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc626525-42a7-4364-a207-81b403904380', 'volume_name': 'volume-bc626525-42a7-4364-a207-81b403904380', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b85bf1c-9a71-4916-8266-bac488c872f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b85bf1c-9a71-4916-8266-bac488c872f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a711411d-438f-49b6-8e05-720261979c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:48 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Volume bc626525-42a7-4364-a207-81b403904380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc626525-42a7-4364-a207-81b403904380', 'volume_size': 1} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-662400385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc626525-42a7-4364-a207-81b403904380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172b9469f79c4fd29fcf1c606389089f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:14:48Z,use_quota=True,user_id='c257d722ac994c7783cc55329e715575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Creating volume bc626525-42a7-4364-a207-81b403904380 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:14:48 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc626525-42a7-4364-a207-81b403904380 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:48 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc626525-42a7-4364-a207-81b403904380 1073741824 Jul 09 14:14:48 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] Acquiring lock "cinder-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] Lock "cinder-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] Acquiring lock "cinder-quobyte-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] Lock "cinder-quobyte-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2bf2f1-7bc9-413b-b021-515456378927]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:14:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:49 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7 Jul 09 14:14:49 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:49 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc626525-42a7-4364-a207-81b403904380 1073741824" returned: 0 in 1.081s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc626525-42a7-4364-a207-81b403904380 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:49 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc626525-42a7-4364-a207-81b403904380 Jul 09 14:14:49 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:50 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7" returned: 0 in 1.159s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:50 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7 Jul 09 14:14:50 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:50 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc626525-42a7-4364-a207-81b403904380" returned: 0 in 0.876s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:14:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a711411d-438f-49b6-8e05-720261979c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc626525-42a7-4364-a207-81b403904380', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e6d6d5-fc38-4ed9-97c7-d35775efe6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:14:50 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Volume volume-bc626525-42a7-4364-a207-81b403904380 (bc626525-42a7-4364-a207-81b403904380): created successfully Jul 09 14:14:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e6d6d5-fc38-4ed9-97c7-d35775efe6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:14:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Flow 'volume_create_manager' (d25065a1-e30f-44c9-96fb-1cad0221b829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:14:50 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b7bf85bf-8955-4c16-9889-4b18718145cf tempest-VolumesActionsTest-109106840 None] Created volume successfully. Jul 09 14:14:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:50 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Cloning volume 32f46ae0-c190-4c46-bb4f-01c6bbc85a31 to volume afa04dd0-2064-43cd-9463-95e84de0b092 Jul 09 14:14:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Creating offline snapshot 8653ca22-d31d-4e7a-a6b5-614fbabd06d4 of volume 32f46ae0-c190-4c46-bb4f-01c6bbc85a31 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:14:50 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[001b40a5-bbc0-49c2-b8e0-9a5cf7e50858]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:14:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:51 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 Jul 09 14:14:51 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:51 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7" returned: 0 in 1.099s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] Lock "cinder-quobyte-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7" released by "delete_volume" :: held 2.308s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:51 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] Created reservations ['d627cd5a-fe01-40aa-9701-cd30d1f38c10', '727729aa-5e99-4cc3-929d-2bbddeb92248', '79430870-5fdb-4e17-866b-5f35c2270b05', '83a1f991-ccb9-4d47-b5a9-356dd182a3b6'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:14:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:14:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:14:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:51 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:14:51 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9778739b-1ba0-4c18-b2d3-2a85b89e4987 tempest-VolumesActionsTest-109106840 None] Acquiring lock "cinder-bc626525-42a7-4364-a207-81b403904380" by "attach_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9778739b-1ba0-4c18-b2d3-2a85b89e4987 tempest-VolumesActionsTest-109106840 None] Lock "cinder-bc626525-42a7-4364-a207-81b403904380" acquired by "attach_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:51 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9778739b-1ba0-4c18-b2d3-2a85b89e4987 tempest-VolumesActionsTest-109106840 None] Attaching volume bc626525-42a7-4364-a207-81b403904380 to instance eeb8c82a-5b20-40ae-8ed2-a58562598a34 at mountpoint /dev/vdb on host None. Jul 09 14:14:51 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9778739b-1ba0-4c18-b2d3-2a85b89e4987 tempest-VolumesActionsTest-109106840 None] Attach volume completed successfully. Jul 09 14:14:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9778739b-1ba0-4c18-b2d3-2a85b89e4987 tempest-VolumesActionsTest-109106840 None] Lock "cinder-bc626525-42a7-4364-a207-81b403904380" released by "attach_volume" :: held 0.104s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:51 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31" returned: 0 in 1.076s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:51 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4 1G Jul 09 14:14:51 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:52 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.885s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:52 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:14:52 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] Deleted volume successfully. Jul 09 14:14:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-913ed91d-1a21-4171-9422-2c3c72ff288e tempest-VolumeQuotasNegativeTestJSON-603914037 None] Lock "cinder-bd5767d3-bad6-4bc2-b2c2-ee045ea07ce7-delete_volume" released by "delete_volume" :: held 3.593s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:53 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9d1333e5-1c2d-4bf8-a2da-7d632af160fb tempest-VolumesActionsTest-889013440 None] Terminate volume connection completed successfully. Jul 09 14:14:53 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4 1G" returned: 0 in 1.328s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:53 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4 Jul 09 14:14:53 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9d1333e5-1c2d-4bf8-a2da-7d632af160fb tempest-VolumesActionsTest-889013440 None] Acquiring lock "cinder-bc626525-42a7-4364-a207-81b403904380-detach_volume" by "detach_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9d1333e5-1c2d-4bf8-a2da-7d632af160fb tempest-VolumesActionsTest-889013440 None] Lock "cinder-bc626525-42a7-4364-a207-81b403904380-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:53 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9d1333e5-1c2d-4bf8-a2da-7d632af160fb tempest-VolumesActionsTest-889013440 None] Detaching volume bc626525-42a7-4364-a207-81b403904380 from instance eeb8c82a-5b20-40ae-8ed2-a58562598a34. Jul 09 14:14:53 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9d1333e5-1c2d-4bf8-a2da-7d632af160fb tempest-VolumesActionsTest-889013440 None] Detach volume completed successfully. Jul 09 14:14:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9d1333e5-1c2d-4bf8-a2da-7d632af160fb tempest-VolumesActionsTest-889013440 None] Lock "cinder-bc626525-42a7-4364-a207-81b403904380-detach_volume" released by "detach_volume" :: held 0.099s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:54 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b6bcf698-6296-4758-81ed-8205db902f46 tempest-VolumesActionsTest-109106840 None] Acquiring lock "cinder-bc626525-42a7-4364-a207-81b403904380-detach_volume" by "detach_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4" returned: 0 in 1.109s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:54 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 14:14:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b6bcf698-6296-4758-81ed-8205db902f46 tempest-VolumesActionsTest-109106840 None] Lock "cinder-bc626525-42a7-4364-a207-81b403904380-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:54 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b6bcf698-6296-4758-81ed-8205db902f46 tempest-VolumesActionsTest-109106840 None] Volume detach called, but volume not attached. Jul 09 14:14:54 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4 Jul 09 14:14:54 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b6bcf698-6296-4758-81ed-8205db902f46 tempest-VolumesActionsTest-109106840 None] Lock "cinder-bc626525-42a7-4364-a207-81b403904380-detach_volume" released by "detach_volume" :: held 0.052s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] Acquiring lock "cinder-bc626525-42a7-4364-a207-81b403904380-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] Lock "cinder-bc626525-42a7-4364-a207-81b403904380-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] Acquiring lock "cinder-quobyte-bc626525-42a7-4364-a207-81b403904380" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] Lock "cinder-quobyte-bc626525-42a7-4364-a207-81b403904380" acquired by "delete_volume" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:55 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1379d3-079f-4758-8edb-c63b49721ec0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:14:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc626525-42a7-4364-a207-81b403904380 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:55 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4" returned: 0 in 1.059s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:55 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.info Jul 09 14:14:55 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:55 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc626525-42a7-4364-a207-81b403904380 Jul 09 14:14:55 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:56 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc626525-42a7-4364-a207-81b403904380" returned: 0 in 1.166s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc626525-42a7-4364-a207-81b403904380 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:56 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc626525-42a7-4364-a207-81b403904380 Jul 09 14:14:56 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:56 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.info" returned: 0 in 1.403s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:56 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 14:14:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:56 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.info Jul 09 14:14:56 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:57 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.info" returned: 0 in 1.117s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:58 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Acquiring lock "cinder-quobyte-afa04dd0-2064-43cd-9463-95e84de0b092" by "_copy_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc626525-42a7-4364-a207-81b403904380" returned: 0 in 1.493s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Lock "cinder-quobyte-afa04dd0-2064-43cd-9463-95e84de0b092" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] snapshot: 8653ca22-d31d-4e7a-a6b5-614fbabd06d4, volume: afa04dd0-2064-43cd-9463-95e84de0b092, {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] Lock "cinder-quobyte-bc626525-42a7-4364-a207-81b403904380" released by "delete_volume" :: held 2.755s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[88656b05-e493-4c45-b03d-a0b030c2ba80]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] Created reservations ['2d669814-f32f-456a-80fb-985159904cbc', 'de0ea4f3-3d5f-46fd-bd78-7308b5357a97', '25fa903b-0c31-4352-ba5b-15788cc0fc76', '0ecf167b-2461-45a9-98c0-bf87a21e0991'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:14:58 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4 Jul 09 14:14:58 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:14:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:58 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:14:58 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:14:59 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4" returned: 0 in 1.113s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:14:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 14:14:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Creating direct copy from snapshot {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 14:14:59 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Jul 09 14:14:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.914s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:14:59 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:14:59 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cba669-ec56-49b5-99e5-df8f6b261ee8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:14:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:14:59 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] Deleted volume successfully. Jul 09 14:14:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad931337-f923-479c-b7f4-1e54d58d0e77 tempest-VolumesActionsTest-109106840 None] Lock "cinder-bc626525-42a7-4364-a207-81b403904380-delete_volume" released by "delete_volume" :: held 4.067s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:14:59 devstack sudo[95182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 Jul 09 14:14:59 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:00 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31" returned: 0 in 0.857s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:00 devstack cinder-volume[87011]: DEBUG cinder.utils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Path /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-afa04dd0-2064-43cd-9463-95e84de0b092 not found in is_blk_device check {{(pid=87011) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 14:15:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-afa04dd0-2064-43cd-9463-95e84de0b092 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:00 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-afa04dd0-2064-43cd-9463-95e84de0b092 Jul 09 14:15:00 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:02 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:15:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Flow 'volume_create_manager' (45ed1ce7-5cad-47ff-8f0b-0aa10297b7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:15:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f7431c-07b0-4c5a-bb9f-841fb17b2a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f7431c-07b0-4c5a-bb9f-841fb17b2a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1956732914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b437af4-5974-4ac1-a0d9-2870d87f0c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f8fc2afa70841d7aa89e38e4776e103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:15:02Z,use_quota=True,user_id='f16a26a1213843c9aac222133b3af915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bf527e2-da08-4e33-97aa-f2f1ab092160),volume_type_id=7bf527e2-da08-4e33-97aa-f2f1ab092160)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e15876-9324-47ae-9f4c-68ed801eb324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e15876-9324-47ae-9f4c-68ed801eb324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320031fa-4012-4e58-b939-ef1d2492bd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320031fa-4012-4e58-b939-ef1d2492bd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b437af4-5974-4ac1-a0d9-2870d87f0c89', 'volume_name': 'volume-3b437af4-5974-4ac1-a0d9-2870d87f0c89', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8039f5-d682-4386-88e6-ca2cb7428c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8039f5-d682-4386-88e6-ca2cb7428c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00b8d54-8c2f-49ce-8885-67a5eba2249f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:02 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Volume 3b437af4-5974-4ac1-a0d9-2870d87f0c89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b437af4-5974-4ac1-a0d9-2870d87f0c89', 'volume_size': 1} Jul 09 14:15:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:07 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-afa04dd0-2064-43cd-9463-95e84de0b092" returned: 0 in 7.755s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:07 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b3ccb4-be2d-479f-9ea2-9cff3edc076b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:15:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:08 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 Jul 09 14:15:08 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:08 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31" returned: 0 in 1.032s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:08 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31, size 1024.00 MB, duration 7.76 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-afa04dd0-2064-43cd-9463-95e84de0b092 {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:15:08 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Converted 1024.00 MB image at 132.00 MB/s Jul 09 14:15:08 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-afa04dd0-2064-43cd-9463-95e84de0b092 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 14:15:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-afa04dd0-2064-43cd-9463-95e84de0b092 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:09 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-afa04dd0-2064-43cd-9463-95e84de0b092 Jul 09 14:15:09 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Flow 'volume_create_manager' (464cf20b-a803-48ac-86a8-62c926bf8a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b3e1ee-ed26-4adb-86a1-546837635225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b3e1ee-ed26-4adb-86a1-546837635225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-49720462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65433612-500c-44f8-abb0-dcdb17389b2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172b9469f79c4fd29fcf1c606389089f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:15:09Z,use_quota=True,user_id='c257d722ac994c7783cc55329e715575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037fb940-d960-49b1-90eb-e5312d442e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037fb940-d960-49b1-90eb-e5312d442e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9cc26b3-e0aa-4ead-aa89-14d53667e56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9cc26b3-e0aa-4ead-aa89-14d53667e56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65433612-500c-44f8-abb0-dcdb17389b2f', 'volume_name': 'volume-65433612-500c-44f8-abb0-dcdb17389b2f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f968bb74-fa06-4493-90a4-b66da730fd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f968bb74-fa06-4493-90a4-b66da730fd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3ee413-9273-4b81-81ed-21f2bff487d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:09 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Volume 65433612-500c-44f8-abb0-dcdb17389b2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65433612-500c-44f8-abb0-dcdb17389b2f', 'volume_size': 1} Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:09 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-afa04dd0-2064-43cd-9463-95e84de0b092" returned: 0 in 0.887s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Lock "cinder-quobyte-afa04dd0-2064-43cd-9463-95e84de0b092" released by "_copy_volume_from_snapshot" :: held 11.787s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Acquiring lock "cinder-quobyte-8653ca22-d31d-4e7a-a6b5-614fbabd06d4" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Lock "cinder-quobyte-8653ca22-d31d-4e7a-a6b5-614fbabd06d4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Deleting offline snapshot 8653ca22-d31d-4e7a-a6b5-614fbabd06d4 of volume 32f46ae0-c190-4c46-bb4f-01c6bbc85a31 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] snapshot_file for this snap is: volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[0968020f-536a-43d4-a378-f911a89217c4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:15:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:10 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4 Jul 09 14:15:10 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:10 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4" returned: 0 in 0.749s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:15:10 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[4316c442-00ad-4dd6-9820-5f5c987c6c8f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:15:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:10 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 Jul 09 14:15:10 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:11 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31" returned: 0 in 0.734s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:11 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4 Jul 09 14:15:11 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:12 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4" returned: 0 in 0.750s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:12 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4 Jul 09 14:15:12 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:12 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:15:12 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:12 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31.8653ca22-d31d-4e7a-a6b5-614fbabd06d4" returned: 0 in 0.680s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Lock "cinder-quobyte-8653ca22-d31d-4e7a-a6b5-614fbabd06d4" released by "_delete_snapshot" :: held 3.001s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.160s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.718s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1956732914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b437af4-5974-4ac1-a0d9-2870d87f0c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f8fc2afa70841d7aa89e38e4776e103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:15:02Z,use_quota=True,user_id='f16a26a1213843c9aac222133b3af915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bf527e2-da08-4e33-97aa-f2f1ab092160),volume_type_id=7bf527e2-da08-4e33-97aa-f2f1ab092160)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Creating volume 3b437af4-5974-4ac1-a0d9-2870d87f0c89 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:15:12 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:15:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3b437af4-5974-4ac1-a0d9-2870d87f0c89 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:12 devstack sudo[95648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3b437af4-5974-4ac1-a0d9-2870d87f0c89 1073741824 Jul 09 14:15:12 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:13 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b5a91476-a3bc-4c59-a765-3a34d5fda250 tempest-GroupsV314Test-1660977482 None] Create group from source-group-8e95ef61-5641-4e3e-bf03-854fd650302e completed successfully. Jul 09 14:15:13 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.736s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:15:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:15:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 8 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:15:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:15:13 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3b437af4-5974-4ac1-a0d9-2870d87f0c89 1073741824" returned: 0 in 0.847s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3b437af4-5974-4ac1-a0d9-2870d87f0c89 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:13 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3b437af4-5974-4ac1-a0d9-2870d87f0c89 Jul 09 14:15:13 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] Acquiring lock "cinder-quobyte-afa04dd0-2064-43cd-9463-95e84de0b092" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] Lock "cinder-quobyte-afa04dd0-2064-43cd-9463-95e84de0b092" acquired by "delete_volume" :: waited 0.033s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c05fc0-c8dc-4d1d-b1d4-6840cbe74d69]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-afa04dd0-2064-43cd-9463-95e84de0b092 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:14 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3b437af4-5974-4ac1-a0d9-2870d87f0c89" returned: 0 in 0.641s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.796s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-49720462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65433612-500c-44f8-abb0-dcdb17389b2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172b9469f79c4fd29fcf1c606389089f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:15:09Z,use_quota=True,user_id='c257d722ac994c7783cc55329e715575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Creating volume 65433612-500c-44f8-abb0-dcdb17389b2f {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:15:14 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-65433612-500c-44f8-abb0-dcdb17389b2f 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:14 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-afa04dd0-2064-43cd-9463-95e84de0b092 Jul 09 14:15:14 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00b8d54-8c2f-49ce-8885-67a5eba2249f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b437af4-5974-4ac1-a0d9-2870d87f0c89', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:14 devstack sudo[95658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-65433612-500c-44f8-abb0-dcdb17389b2f 1073741824 Jul 09 14:15:14 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87df4e13-fd87-425f-8b51-c57faf8c0d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:14 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Volume volume-3b437af4-5974-4ac1-a0d9-2870d87f0c89 (3b437af4-5974-4ac1-a0d9-2870d87f0c89): created successfully Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87df4e13-fd87-425f-8b51-c57faf8c0d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Flow 'volume_create_manager' (45ed1ce7-5cad-47ff-8f0b-0aa10297b7a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:15:14 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-73deabfa-f89a-4df0-8527-b85d68b62e9d tempest-VolumeTypesAccessTest-1650784537 None] Created volume successfully. Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Acquiring lock "cinder-3b437af4-5974-4ac1-a0d9-2870d87f0c89-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Lock "cinder-3b437af4-5974-4ac1-a0d9-2870d87f0c89-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Acquiring lock "cinder-quobyte-3b437af4-5974-4ac1-a0d9-2870d87f0c89" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Lock "cinder-quobyte-3b437af4-5974-4ac1-a0d9-2870d87f0c89" acquired by "delete_volume" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba3cf50-0e88-4c0e-a948-f0beaf5bd3c8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:15:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3b437af4-5974-4ac1-a0d9-2870d87f0c89 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:15 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3b437af4-5974-4ac1-a0d9-2870d87f0c89 Jul 09 14:15:15 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:15 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-afa04dd0-2064-43cd-9463-95e84de0b092" returned: 0 in 1.106s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-afa04dd0-2064-43cd-9463-95e84de0b092 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:15 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-65433612-500c-44f8-abb0-dcdb17389b2f 1073741824" returned: 0 in 1.017s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:15 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-afa04dd0-2064-43cd-9463-95e84de0b092 Jul 09 14:15:15 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-65433612-500c-44f8-abb0-dcdb17389b2f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:15 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-65433612-500c-44f8-abb0-dcdb17389b2f Jul 09 14:15:15 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:16 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3b437af4-5974-4ac1-a0d9-2870d87f0c89" returned: 0 in 1.076s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3b437af4-5974-4ac1-a0d9-2870d87f0c89 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:16 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3b437af4-5974-4ac1-a0d9-2870d87f0c89 Jul 09 14:15:16 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:16 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-65433612-500c-44f8-abb0-dcdb17389b2f" returned: 0 in 0.793s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3ee413-9273-4b81-81ed-21f2bff487d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65433612-500c-44f8-abb0-dcdb17389b2f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:16 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94fc3f4-d90a-450c-8a31-2c71216925c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-afa04dd0-2064-43cd-9463-95e84de0b092" returned: 0 in 0.906s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] Lock "cinder-quobyte-afa04dd0-2064-43cd-9463-95e84de0b092" released by "delete_volume" :: held 2.060s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:16 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Volume volume-65433612-500c-44f8-abb0-dcdb17389b2f (65433612-500c-44f8-abb0-dcdb17389b2f): created successfully Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94fc3f4-d90a-450c-8a31-2c71216925c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Flow 'volume_create_manager' (464cf20b-a803-48ac-86a8-62c926bf8a08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:15:16 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ec13a46b-f0f4-40e7-83c1-b8164dd63f73 tempest-VolumesActionsTest-109106840 None] Created volume successfully. Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] Created reservations ['abb4aa84-ba90-4e4c-a260-64c15b5c9f95'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:15:16 devstack cinder-volume[87011]: WARNING cinder.quota [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1642650741 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1642650741, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:15:16 devstack cinder-volume[87011]: WARNING cinder.quota [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1642650741 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1642650741, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] Created reservations ['595d003d-74cc-4e95-a694-95a5a25cb3de', 'ad2c68a3-fd9b-46ae-8f8a-c6c3a25e92f7', 'ba73cd38-8ab1-4e7f-872d-712897c50886', 'e9fa007a-aca6-4151-aaa9-1e34fa448914'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:16 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:15:16 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:16 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3b437af4-5974-4ac1-a0d9-2870d87f0c89" returned: 0 in 0.686s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Lock "cinder-quobyte-3b437af4-5974-4ac1-a0d9-2870d87f0c89" released by "delete_volume" :: held 1.815s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:16 devstack cinder-volume[87011]: WARNING cinder.quota [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-399084062 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-399084062, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:15:16 devstack cinder-volume[87011]: WARNING cinder.quota [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-399084062 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-399084062, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Created reservations ['a0299dc1-3cb4-41ad-b0c3-dd5866471108', '8bca9456-1a04-4940-a1d9-b1cc54d5ed8a', '6d0e2085-2e56-4e68-8cf1-8e71a416b0f5', 'a0bb4f99-fbd1-49ad-90b9-4c4730bae3a5'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:16 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:15:16 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-964be672-765e-4395-8d6d-fd53174c2567 tempest-GroupsV314Test-1660977482 None] Acquiring lock "cinder-quobyte-32f46ae0-c190-4c46-bb4f-01c6bbc85a31" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-964be672-765e-4395-8d6d-fd53174c2567 tempest-GroupsV314Test-1660977482 None] Lock "cinder-quobyte-32f46ae0-c190-4c46-bb4f-01c6bbc85a31" acquired by "delete_volume" :: waited 0.031s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:17 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd96aea-13d3-4394-a0c0-23aafbc802ca]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:15:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-964be672-765e-4395-8d6d-fd53174c2567 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:17 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 Jul 09 14:15:17 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] Acquiring lock "cinder-65433612-500c-44f8-abb0-dcdb17389b2f-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] Lock "cinder-65433612-500c-44f8-abb0-dcdb17389b2f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:17 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.813s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:17 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:15:17 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-fca0d869-1431-4078-8c47-af5c203ea702 tempest-GroupsV314Test-1660977482 None] Delete group completed successfully. Jul 09 14:15:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] Acquiring lock "cinder-quobyte-65433612-500c-44f8-abb0-dcdb17389b2f" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] Lock "cinder-quobyte-65433612-500c-44f8-abb0-dcdb17389b2f" acquired by "delete_volume" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:17 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[39874c41-2bea-4ff7-a0c0-d75dd33a50a7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:15:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-65433612-500c-44f8-abb0-dcdb17389b2f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:17 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-65433612-500c-44f8-abb0-dcdb17389b2f Jul 09 14:15:17 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:17 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.830s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:17 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:15:17 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Deleted volume successfully. Jul 09 14:15:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e6bb3bf8-cc12-40ce-b96f-2fbbadd5db68 tempest-VolumeTypesAccessTest-1650784537 None] Lock "cinder-3b437af4-5974-4ac1-a0d9-2870d87f0c89-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:18 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-964be672-765e-4395-8d6d-fd53174c2567 tempest-GroupsV314Test-1660977482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31" returned: 0 in 0.967s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-964be672-765e-4395-8d6d-fd53174c2567 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:18 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31 Jul 09 14:15:18 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:18 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-65433612-500c-44f8-abb0-dcdb17389b2f" returned: 0 in 0.884s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-65433612-500c-44f8-abb0-dcdb17389b2f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:18 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-65433612-500c-44f8-abb0-dcdb17389b2f Jul 09 14:15:18 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:18 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-964be672-765e-4395-8d6d-fd53174c2567 tempest-GroupsV314Test-1660977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-32f46ae0-c190-4c46-bb4f-01c6bbc85a31" returned: 0 in 0.696s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-964be672-765e-4395-8d6d-fd53174c2567 tempest-GroupsV314Test-1660977482 None] Lock "cinder-quobyte-32f46ae0-c190-4c46-bb4f-01c6bbc85a31" released by "delete_volume" :: held 1.746s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:18 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-964be672-765e-4395-8d6d-fd53174c2567 tempest-GroupsV314Test-1660977482 None] Created reservations ['4698c397-5c63-4a04-bf0f-c18071276d39'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:15:18 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-964be672-765e-4395-8d6d-fd53174c2567 tempest-GroupsV314Test-1660977482 None] Created reservations ['2dea19ee-7e8d-4fe0-8f58-f4afc4808dd3', '002d555d-b774-46fb-a278-33adf16c6c38', '57eec4a0-2ce4-4847-bdfd-55329a809f64', '4684d3da-c78a-414a-aaf4-00ad69c639ad'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:15:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-964be672-765e-4395-8d6d-fd53174c2567 tempest-GroupsV314Test-1660977482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-964be672-765e-4395-8d6d-fd53174c2567 tempest-GroupsV314Test-1660977482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-964be672-765e-4395-8d6d-fd53174c2567 tempest-GroupsV314Test-1660977482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-964be672-765e-4395-8d6d-fd53174c2567 tempest-GroupsV314Test-1660977482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-964be672-765e-4395-8d6d-fd53174c2567 tempest-GroupsV314Test-1660977482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-964be672-765e-4395-8d6d-fd53174c2567 tempest-GroupsV314Test-1660977482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:19 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:15:19 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:19 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-65433612-500c-44f8-abb0-dcdb17389b2f" returned: 0 in 0.746s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] Lock "cinder-quobyte-65433612-500c-44f8-abb0-dcdb17389b2f" released by "delete_volume" :: held 1.694s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:19 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] Created reservations ['dbf198a3-e112-4839-b7ab-50e14610d1ab', '7c300da6-48e9-4fb0-ac26-5a5da2a0aaad', '9e7b6ae7-0066-48ec-adea-6ef0f0e8106d', '4e16b304-3a23-4ad8-9166-cb9a14edc1fc'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:15:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:19 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:15:19 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:20 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-964be672-765e-4395-8d6d-fd53174c2567 tempest-GroupsV314Test-1660977482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.968s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-964be672-765e-4395-8d6d-fd53174c2567 tempest-GroupsV314Test-1660977482 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:15:20 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-964be672-765e-4395-8d6d-fd53174c2567 tempest-GroupsV314Test-1660977482 None] Delete group completed successfully. Jul 09 14:15:20 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.990s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:15:20 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] Deleted volume successfully. Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Flow 'volume_create_manager' (f3b63b87-5853-450a-af7e-a1eb39e22234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0095bf82-077d-45cf-878e-1a795ae4463d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0095bf82-077d-45cf-878e-1a795ae4463d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1409057057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a7f4d1-6528-481e-8c88-20c340857f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172b9469f79c4fd29fcf1c606389089f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:15:20Z,use_quota=True,user_id='c257d722ac994c7783cc55329e715575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2edf7f50-8f55-4b53-921c-709b003f0125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2edf7f50-8f55-4b53-921c-709b003f0125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5ee885-362f-4557-9de0-a91886352f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5ee885-362f-4557-9de0-a91886352f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88a7f4d1-6528-481e-8c88-20c340857f5a', 'volume_name': 'volume-88a7f4d1-6528-481e-8c88-20c340857f5a', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b399c1-824d-4ef7-b627-f6cfb9e5c66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b399c1-824d-4ef7-b627-f6cfb9e5c66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9bec17-2b2b-4d02-80e6-d3fe773e4d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:20 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Volume 88a7f4d1-6528-481e-8c88-20c340857f5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88a7f4d1-6528-481e-8c88-20c340857f5a', 'volume_size': 1} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1409057057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a7f4d1-6528-481e-8c88-20c340857f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172b9469f79c4fd29fcf1c606389089f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:15:20Z,use_quota=True,user_id='c257d722ac994c7783cc55329e715575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Creating volume 88a7f4d1-6528-481e-8c88-20c340857f5a {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:15:20 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-88a7f4d1-6528-481e-8c88-20c340857f5a 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:20 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-22f3b5e2-84a4-4ee3-9333-a967a3668e3e tempest-VolumesActionsTest-889013440 None] Lock "cinder-65433612-500c-44f8-abb0-dcdb17389b2f-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:20 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-88a7f4d1-6528-481e-8c88-20c340857f5a 1073741824 Jul 09 14:15:20 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:21 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-88a7f4d1-6528-481e-8c88-20c340857f5a 1073741824" returned: 0 in 1.081s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-88a7f4d1-6528-481e-8c88-20c340857f5a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:21 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-88a7f4d1-6528-481e-8c88-20c340857f5a Jul 09 14:15:21 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:22 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-88a7f4d1-6528-481e-8c88-20c340857f5a" returned: 0 in 0.998s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:22 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:15:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.149s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9bec17-2b2b-4d02-80e6-d3fe773e4d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88a7f4d1-6528-481e-8c88-20c340857f5a', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03ad295-7e61-4eb9-9fa2-f8e84b091ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:22 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Volume volume-88a7f4d1-6528-481e-8c88-20c340857f5a (88a7f4d1-6528-481e-8c88-20c340857f5a): created successfully Jul 09 14:15:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03ad295-7e61-4eb9-9fa2-f8e84b091ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Flow 'volume_create_manager' (f3b63b87-5853-450a-af7e-a1eb39e22234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:15:22 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-40e95d29-eec4-4d41-8b04-58391add8fd6 tempest-VolumesActionsTest-109106840 None] Created volume successfully. Jul 09 14:15:23 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] Acquiring lock "cinder-88a7f4d1-6528-481e-8c88-20c340857f5a-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:23 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] Lock "cinder-88a7f4d1-6528-481e-8c88-20c340857f5a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:23 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] Acquiring lock "cinder-quobyte-88a7f4d1-6528-481e-8c88-20c340857f5a" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:23 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] Lock "cinder-quobyte-88a7f4d1-6528-481e-8c88-20c340857f5a" acquired by "delete_volume" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:23 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37251a8-a26b-4d84-9b01-91f1f4c083e6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:15:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-88a7f4d1-6528-481e-8c88-20c340857f5a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:23 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-88a7f4d1-6528-481e-8c88-20c340857f5a Jul 09 14:15:23 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:24 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-88a7f4d1-6528-481e-8c88-20c340857f5a" returned: 0 in 0.834s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-88a7f4d1-6528-481e-8c88-20c340857f5a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:24 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-88a7f4d1-6528-481e-8c88-20c340857f5a Jul 09 14:15:24 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:25 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-88a7f4d1-6528-481e-8c88-20c340857f5a" returned: 0 in 0.670s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:25 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] Lock "cinder-quobyte-88a7f4d1-6528-481e-8c88-20c340857f5a" released by "delete_volume" :: held 1.556s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:25 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] Created reservations ['7f808641-1a17-42f5-a1fa-b4b5b9eb4f47', 'd413bd92-1c04-4dac-9f9a-e60eaff2931d', '7faba8f3-5807-4e0a-9611-2478f3a6ef6a', '24b5ab5b-c549-4cbf-8f03-d225dc547fb3'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:15:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:25 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:15:25 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:25 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b9e42851-4d40-4579-a258-cb5ba8b3e78c tempest-GroupsV320Test-983044655 None] Group tempest-GroupsV320Test-Group-1479825813: creating Jul 09 14:15:25 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b9e42851-4d40-4579-a258-cb5ba8b3e78c tempest-GroupsV320Test-983044655 None] Group tempest-GroupsV320Test-Group-1479825813: created successfully Jul 09 14:15:25 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b9e42851-4d40-4579-a258-cb5ba8b3e78c tempest-GroupsV320Test-983044655 None] Create group completed successfully. Jul 09 14:15:26 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.814s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:15:26 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] Deleted volume successfully. Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1d073539-200e-470e-a44a-13315f8c30b5 tempest-VolumesActionsTest-889013440 None] Lock "cinder-88a7f4d1-6528-481e-8c88-20c340857f5a-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Flow 'volume_create_manager' (babc7417-6bb1-4163-96ec-9ac25d9d92de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9731360-8abb-47e1-acc4-432711223091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9731360-8abb-47e1-acc4-432711223091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-10450380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3ee529-0330-44c1-84a5-4da5c5424649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172b9469f79c4fd29fcf1c606389089f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:15:26Z,use_quota=True,user_id='c257d722ac994c7783cc55329e715575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859335d5-5cf0-466e-ac6c-e5e9f1c3ef35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859335d5-5cf0-466e-ac6c-e5e9f1c3ef35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0ea461-c8cb-47be-bfd4-c578cd582135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0ea461-c8cb-47be-bfd4-c578cd582135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d3ee529-0330-44c1-84a5-4da5c5424649', 'volume_name': 'volume-7d3ee529-0330-44c1-84a5-4da5c5424649', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4212fae6-d175-4175-a695-1c8fcf9b39d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4212fae6-d175-4175-a695-1c8fcf9b39d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31c99b4-9caa-4b5a-bcfb-100029826545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:26 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Volume 7d3ee529-0330-44c1-84a5-4da5c5424649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d3ee529-0330-44c1-84a5-4da5c5424649', 'volume_size': 1} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-10450380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3ee529-0330-44c1-84a5-4da5c5424649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172b9469f79c4fd29fcf1c606389089f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:15:26Z,use_quota=True,user_id='c257d722ac994c7783cc55329e715575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Creating volume 7d3ee529-0330-44c1-84a5-4da5c5424649 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:15:26 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:15:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d3ee529-0330-44c1-84a5-4da5c5424649 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:26 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d3ee529-0330-44c1-84a5-4da5c5424649 1073741824 Jul 09 14:15:26 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:27 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-b0817c78-40af-47d5-b5e4-f1b544160edb tempest-GroupsV320Test-983044655 None] Created reservations ['9bb8bcbf-3add-463d-9943-004583c00ad4'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:15:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b0817c78-40af-47d5-b5e4-f1b544160edb tempest-GroupsV320Test-983044655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b0817c78-40af-47d5-b5e4-f1b544160edb tempest-GroupsV320Test-983044655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:27 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b0817c78-40af-47d5-b5e4-f1b544160edb tempest-GroupsV320Test-983044655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:27 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b0817c78-40af-47d5-b5e4-f1b544160edb tempest-GroupsV320Test-983044655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b0817c78-40af-47d5-b5e4-f1b544160edb tempest-GroupsV320Test-983044655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b0817c78-40af-47d5-b5e4-f1b544160edb tempest-GroupsV320Test-983044655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:27 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:15:27 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:27 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d3ee529-0330-44c1-84a5-4da5c5424649 1073741824" returned: 0 in 1.056s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d3ee529-0330-44c1-84a5-4da5c5424649 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:27 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d3ee529-0330-44c1-84a5-4da5c5424649 Jul 09 14:15:27 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:28 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-98ec4d3e-b722-4b78-a824-d42c134cc32d req-b4d92179-f1de-4ba5-9ebe-53cb6737cdb4 tempest-AttachVolumeTestJSON-1739532221 None] Terminate volume connection completed successfully. Jul 09 14:15:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-98ec4d3e-b722-4b78-a824-d42c134cc32d req-b4d92179-f1de-4ba5-9ebe-53cb6737cdb4 tempest-AttachVolumeTestJSON-1739532221 None] Deleting attachment 6b5480c0-4070-4c63-be43-d86e48b4b6ab. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:15:28 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:28 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b0817c78-40af-47d5-b5e4-f1b544160edb tempest-GroupsV320Test-983044655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.881s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:28 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-b0817c78-40af-47d5-b5e4-f1b544160edb tempest-GroupsV320Test-983044655 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:15:28 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b0817c78-40af-47d5-b5e4-f1b544160edb tempest-GroupsV320Test-983044655 None] Delete group completed successfully. Jul 09 14:15:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d3ee529-0330-44c1-84a5-4da5c5424649" returned: 0 in 0.762s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:15:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31c99b4-9caa-4b5a-bcfb-100029826545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d3ee529-0330-44c1-84a5-4da5c5424649', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196f73d8-f276-4589-b1df-14ded4e4565e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:28 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Volume volume-7d3ee529-0330-44c1-84a5-4da5c5424649 (7d3ee529-0330-44c1-84a5-4da5c5424649): created successfully Jul 09 14:15:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196f73d8-f276-4589-b1df-14ded4e4565e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Flow 'volume_create_manager' (babc7417-6bb1-4163-96ec-9ac25d9d92de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:15:28 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a8e4ab93-18d6-4a5f-ad65-7c19828a8f0a tempest-VolumesActionsTest-109106840 None] Created volume successfully. Jul 09 14:15:28 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] Acquiring lock "cinder-7d3ee529-0330-44c1-84a5-4da5c5424649-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:28 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] Lock "cinder-7d3ee529-0330-44c1-84a5-4da5c5424649-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:28 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] Acquiring lock "cinder-quobyte-7d3ee529-0330-44c1-84a5-4da5c5424649" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:28 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] Lock "cinder-quobyte-7d3ee529-0330-44c1-84a5-4da5c5424649" acquired by "delete_volume" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:29 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[325f4e55-e673-4483-b438-b62ce496a635]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:15:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d3ee529-0330-44c1-84a5-4da5c5424649 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:29 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d3ee529-0330-44c1-84a5-4da5c5424649 Jul 09 14:15:29 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:29 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d3ee529-0330-44c1-84a5-4da5c5424649" returned: 0 in 0.911s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d3ee529-0330-44c1-84a5-4da5c5424649 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:29 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d3ee529-0330-44c1-84a5-4da5c5424649 Jul 09 14:15:29 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:30 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d3ee529-0330-44c1-84a5-4da5c5424649" returned: 0 in 0.801s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] Lock "cinder-quobyte-7d3ee529-0330-44c1-84a5-4da5c5424649" released by "delete_volume" :: held 1.784s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:30 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=108,cinder:INSERT=31,cinder:UPDATE=128,cinder:DELETE=9 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:15:30 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=125,cinder:SELECT=106,cinder:INSERT=25,cinder:DELETE=5 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:15:30 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] Created reservations ['93838d25-164c-41ae-b2f5-e882713f2b86', 'a6e1554e-f383-48d5-91dc-9eba5d613d82', '0759dfe3-e33f-4ba8-b3c4-e86852390d9c', '8ebc42c5-1134-4740-80a0-169a99a119f6'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:15:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:30 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:30 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:30 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:15:30 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:31 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.953s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:31 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:15:31 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] Deleted volume successfully. Jul 09 14:15:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b7c3a40c-40ac-4578-9965-59cd544f26ec tempest-VolumesActionsTest-889013440 None] Lock "cinder-7d3ee529-0330-44c1-84a5-4da5c5424649-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:31 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Flow 'volume_create_manager' (11968ee8-2d41-44b4-a102-6468ae9b9113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb06c41-1fa4-4b5c-b5af-f09f95db582b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb06c41-1fa4-4b5c-b5af-f09f95db582b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-252209884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8347a744-cae6-4665-8e14-a0bc12a75a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172b9469f79c4fd29fcf1c606389089f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:15:32Z,use_quota=True,user_id='c257d722ac994c7783cc55329e715575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341b87d0-83c6-4ba2-9dda-f2293a3baf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (341b87d0-83c6-4ba2-9dda-f2293a3baf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bdb5e3d-de8f-4172-bb06-42611220a018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bdb5e3d-de8f-4172-bb06-42611220a018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8347a744-cae6-4665-8e14-a0bc12a75a99', 'volume_name': 'volume-8347a744-cae6-4665-8e14-a0bc12a75a99', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cd8137-7eb1-4cd6-81e2-c4d363d509f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47cd8137-7eb1-4cd6-81e2-c4d363d509f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325b4341-d403-47b9-8f87-a650ee358231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:32 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Volume 8347a744-cae6-4665-8e14-a0bc12a75a99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8347a744-cae6-4665-8e14-a0bc12a75a99', 'volume_size': 1} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-252209884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8347a744-cae6-4665-8e14-a0bc12a75a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172b9469f79c4fd29fcf1c606389089f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:15:32Z,use_quota=True,user_id='c257d722ac994c7783cc55329e715575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Creating volume 8347a744-cae6-4665-8e14-a0bc12a75a99 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:15:32 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:15:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8347a744-cae6-4665-8e14-a0bc12a75a99 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:32 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8347a744-cae6-4665-8e14-a0bc12a75a99 1073741824 Jul 09 14:15:32 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:33 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8347a744-cae6-4665-8e14-a0bc12a75a99 1073741824" returned: 0 in 1.037s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8347a744-cae6-4665-8e14-a0bc12a75a99 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:33 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8347a744-cae6-4665-8e14-a0bc12a75a99 Jul 09 14:15:33 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:33 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8347a744-cae6-4665-8e14-a0bc12a75a99" returned: 0 in 0.728s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:15:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325b4341-d403-47b9-8f87-a650ee358231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8347a744-cae6-4665-8e14-a0bc12a75a99', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fe3ce24-dc4e-4ed6-bc98-c0ed314be594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:33 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Volume volume-8347a744-cae6-4665-8e14-a0bc12a75a99 (8347a744-cae6-4665-8e14-a0bc12a75a99): created successfully Jul 09 14:15:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fe3ce24-dc4e-4ed6-bc98-c0ed314be594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Flow 'volume_create_manager' (11968ee8-2d41-44b4-a102-6468ae9b9113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:15:34 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-329c4c3a-d5e2-4162-bf64-d11267b7030b tempest-VolumesActionsTest-109106840 None] Created volume successfully. Jul 09 14:15:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] Acquiring lock "cinder-8347a744-cae6-4665-8e14-a0bc12a75a99-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] Lock "cinder-8347a744-cae6-4665-8e14-a0bc12a75a99-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] Acquiring lock "cinder-quobyte-8347a744-cae6-4665-8e14-a0bc12a75a99" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] Lock "cinder-quobyte-8347a744-cae6-4665-8e14-a0bc12a75a99" acquired by "delete_volume" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:35 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5b2fa0-1f9e-4050-9837-c8f1a43f5589]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:15:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8347a744-cae6-4665-8e14-a0bc12a75a99 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:35 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8347a744-cae6-4665-8e14-a0bc12a75a99 Jul 09 14:15:35 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:36 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8347a744-cae6-4665-8e14-a0bc12a75a99" returned: 0 in 0.808s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8347a744-cae6-4665-8e14-a0bc12a75a99 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:36 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8347a744-cae6-4665-8e14-a0bc12a75a99 Jul 09 14:15:36 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:36 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8347a744-cae6-4665-8e14-a0bc12a75a99" returned: 0 in 0.708s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] Lock "cinder-quobyte-8347a744-cae6-4665-8e14-a0bc12a75a99" released by "delete_volume" :: held 1.575s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:37 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] Created reservations ['6346ddf8-3dfd-4140-9ebc-16bd0e32c347', '7f9274cb-74f7-4133-b897-d973c0b1e6a4', 'fd19d902-3289-48bc-a4dd-9b89a9232fe3', '873d2d26-a7db-4907-8d38-d2d41608b82e'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:15:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:37 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:15:37 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:38 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.094s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:15:38 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] Deleted volume successfully. Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-53120bf8-824c-44a6-97a5-382a1fce4b58 tempest-VolumesActionsTest-889013440 None] Lock "cinder-8347a744-cae6-4665-8e14-a0bc12a75a99-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Flow 'volume_create_manager' (ad490db2-68f0-4278-a31d-06f1d94e3ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c3cc57-79da-4400-9d06-14d4d31bb7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c3cc57-79da-4400-9d06-14d4d31bb7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1793734200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5f8441-e31d-4135-bd51-bd65976cdb5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172b9469f79c4fd29fcf1c606389089f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:15:39Z,use_quota=True,user_id='c257d722ac994c7783cc55329e715575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5e5aaf-f2b0-4642-ac03-338c61ee7303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5e5aaf-f2b0-4642-ac03-338c61ee7303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e17eba-404e-4b1b-bc8f-f5712607e727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e17eba-404e-4b1b-bc8f-f5712607e727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd5f8441-e31d-4135-bd51-bd65976cdb5b', 'volume_name': 'volume-dd5f8441-e31d-4135-bd51-bd65976cdb5b', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbb8a69-0e0d-4348-a893-b341afdb0b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbb8a69-0e0d-4348-a893-b341afdb0b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39acc867-06a9-49f9-a877-0f10c0a32892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:38 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Volume dd5f8441-e31d-4135-bd51-bd65976cdb5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd5f8441-e31d-4135-bd51-bd65976cdb5b', 'volume_size': 1} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1793734200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5f8441-e31d-4135-bd51-bd65976cdb5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172b9469f79c4fd29fcf1c606389089f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:15:39Z,use_quota=True,user_id='c257d722ac994c7783cc55329e715575',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Creating volume dd5f8441-e31d-4135-bd51-bd65976cdb5b {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:15:38 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:15:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dd5f8441-e31d-4135-bd51-bd65976cdb5b 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:38 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dd5f8441-e31d-4135-bd51-bd65976cdb5b 1073741824 Jul 09 14:15:38 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:39 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:15:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Flow 'volume_create_manager' (09dd0dcf-55dd-4b94-aab9-4a6a2b458788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:15:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e7cb4b-51fd-4569-908a-b2d646e1a78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e7cb4b-51fd-4569-908a-b2d646e1a78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-962838809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08065ce-b688-4064-8169-ccc2fec253d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918e2c5cd56a4001acd6b817a81d7dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:15:39Z,use_quota=True,user_id='36e3c3eeded3400280f98773260e4e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca25b97-c997-49b3-99b3-4b2963dcd88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca25b97-c997-49b3-99b3-4b2963dcd88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c555836-1d0b-4e2a-88bd-c378c6ea5ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:39 devstack cinder-volume[87011]: DEBUG cinder.image.glance [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Creating Keystone auth plugin from conf {{(pid=87011) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 14:15:39 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dd5f8441-e31d-4135-bd51-bd65976cdb5b 1073741824" returned: 0 in 1.038s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dd5f8441-e31d-4135-bd51-bd65976cdb5b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:39 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dd5f8441-e31d-4135-bd51-bd65976cdb5b Jul 09 14:15:39 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c555836-1d0b-4e2a-88bd-c378c6ea5ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a08065ce-b688-4064-8169-ccc2fec253d5', 'volume_name': 'volume-a08065ce-b688-4064-8169-ccc2fec253d5', 'volume_size': 1, 'image_id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c87c562978df4c18bad93b074708151d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'created_at': datetime.datetime(2026, 7, 9, 12, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fed42dad-a967-43d7-aa04-dfd40efa81d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3268066-acde-4761-88e4-e6de58f32d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3268066-acde-4761-88e4-e6de58f32d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38000ea7-6a9f-4218-8fe7-cf85efd21d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:40 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Volume a08065ce-b688-4064-8169-ccc2fec253d5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a08065ce-b688-4064-8169-ccc2fec253d5', 'volume_size': 1, 'image_id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c87c562978df4c18bad93b074708151d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'created_at': datetime.datetime(2026, 7, 9, 12, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fed42dad-a967-43d7-aa04-dfd40efa81d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 14:15:40 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Trying to clone a08065ce-b688-4064-8169-ccc2fec253d5 from image fed42dad-a967-43d7-aa04-dfd40efa81d3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}]). {{(pid=87011) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 14:15:40 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dd5f8441-e31d-4135-bd51-bd65976cdb5b" returned: 0 in 1.009s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:15:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.101s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39acc867-06a9-49f9-a877-0f10c0a32892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd5f8441-e31d-4135-bd51-bd65976cdb5b', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7933be61-6447-48fd-ba48-f46f6998c376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:41 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Volume volume-dd5f8441-e31d-4135-bd51-bd65976cdb5b (dd5f8441-e31d-4135-bd51-bd65976cdb5b): created successfully Jul 09 14:15:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7933be61-6447-48fd-ba48-f46f6998c376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Flow 'volume_create_manager' (ad490db2-68f0-4278-a31d-06f1d94e3ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:15:41 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-3e72f8e9-2dca-4b1a-bfc5-6e6723d7410f tempest-VolumesActionsTest-109106840 None] Created volume successfully. Jul 09 14:15:41 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_8b45vp5odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 14:15:41 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Image download 20.69 MB at 20.69 MB/s Jul 09 14:15:41 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af29c0c-1902-4cbf-9ba0-c1d4ff28eee2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:15:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_8b45vp5odevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:41 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_8b45vp5odevstack@QuobyteHD Jul 09 14:15:41 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:42 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_8b45vp5odevstack@QuobyteHD" returned: 0 in 1.304s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:42 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Temporary image fed42dad-a967-43d7-aa04-dfd40efa81d3 is fetched for user 36e3c3eeded3400280f98773260e4e2b. {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 14:15:42 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcbd450-ec9a-4e47-ac75-e19168f08383]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:15:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_8b45vp5odevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:42 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_8b45vp5odevstack@QuobyteHD Jul 09 14:15:42 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:43 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] Acquiring lock "cinder-dd5f8441-e31d-4135-bd51-bd65976cdb5b-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:43 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] Lock "cinder-dd5f8441-e31d-4135-bd51-bd65976cdb5b-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:43 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] Acquiring lock "cinder-quobyte-dd5f8441-e31d-4135-bd51-bd65976cdb5b" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:43 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] Lock "cinder-quobyte-dd5f8441-e31d-4135-bd51-bd65976cdb5b" acquired by "delete_volume" :: waited 0.029s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:43 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6176766-f3fe-4166-9a56-2435027adb7a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:15:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dd5f8441-e31d-4135-bd51-bd65976cdb5b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:43 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dd5f8441-e31d-4135-bd51-bd65976cdb5b Jul 09 14:15:43 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:43 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_8b45vp5odevstack@QuobyteHD" returned: 0 in 1.137s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:43 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-962838809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08065ce-b688-4064-8169-ccc2fec253d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='918e2c5cd56a4001acd6b817a81d7dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:15:39Z,use_quota=True,user_id='36e3c3eeded3400280f98773260e4e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:15:43 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Creating volume a08065ce-b688-4064-8169-ccc2fec253d5 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:15:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:43 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:43 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:43 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:15:43 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:15:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:43 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 1073741824 Jul 09 14:15:43 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:44 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dd5f8441-e31d-4135-bd51-bd65976cdb5b" returned: 0 in 1.190s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dd5f8441-e31d-4135-bd51-bd65976cdb5b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:44 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dd5f8441-e31d-4135-bd51-bd65976cdb5b Jul 09 14:15:44 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:45 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 1073741824" returned: 0 in 1.209s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:45 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 Jul 09 14:15:45 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:45 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dd5f8441-e31d-4135-bd51-bd65976cdb5b" returned: 0 in 0.806s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:45 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] Lock "cinder-quobyte-dd5f8441-e31d-4135-bd51-bd65976cdb5b" released by "delete_volume" :: held 2.070s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:45 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] Created reservations ['ac326165-f0a6-4a48-a1f1-b35aed8aaec4', '091b41c4-ff3a-4f83-bdd4-bed884b40f93', 'e36d2507-f2fc-45bc-beb2-4271ae148e4d', '898c4c24-2871-49ef-ac2c-d931dcce98bf'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:15:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:45 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:15:45 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:45 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5" returned: 0 in 0.776s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] <== create_volume: return (2049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:15:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:46 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Attempting download of fed42dad-a967-43d7-aa04-dfd40efa81d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}])) to volume a08065ce-b688-4064-8169-ccc2fec253d5. {{(pid=87011) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 14:15:46 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[546f28c1-3d5a-4033-83f6-b4761b90a0e5]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:15:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_5u3b_j2s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:46 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_5u3b_j2s Jul 09 14:15:46 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:46 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.896s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:46 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:15:46 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] Deleted volume successfully. Jul 09 14:15:46 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-376ceaf2-fc31-4868-b72b-5858a9ba188a tempest-VolumesActionsTest-109106840 None] Lock "cinder-dd5f8441-e31d-4135-bd51-bd65976cdb5b-delete_volume" released by "delete_volume" :: held 3.352s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:46 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_5u3b_j2s" returned: 0 in 0.830s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_5u3b_j2s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:47 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_5u3b_j2s Jul 09 14:15:47 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Flow 'volume_create_manager' (c15eb9f9-3359-44a2-981b-25e24b0686fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48914c1-79be-4ea3-828f-f91e0121b500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a48914c1-79be-4ea3-828f-f91e0121b500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2137269263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9809ac18-1976-4c58-8ff1-8399de5dd0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806725c414614ec498615aed466996c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:15:47Z,use_quota=True,user_id='7c9bd0d3a90741718388f66af38fd95c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb3fa496-f9d1-4dcd-b337-b90d0dc52acd),volume_type_id=fb3fa496-f9d1-4dcd-b337-b90d0dc52acd)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1342d45-ad2c-4daf-adc7-98732e58cf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1342d45-ad2c-4daf-adc7-98732e58cf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec754fa-4ccf-4b86-bf98-90640293b751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec754fa-4ccf-4b86-bf98-90640293b751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9809ac18-1976-4c58-8ff1-8399de5dd0c0', 'volume_name': 'volume-9809ac18-1976-4c58-8ff1-8399de5dd0c0', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44dc0cc9-7be0-4be7-8e3e-e42dc2ed352a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44dc0cc9-7be0-4be7-8e3e-e42dc2ed352a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7b098b-4fbd-474d-8b3a-38141fe2a183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:47 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Volume 9809ac18-1976-4c58-8ff1-8399de5dd0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9809ac18-1976-4c58-8ff1-8399de5dd0c0', 'volume_size': 1} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2137269263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9809ac18-1976-4c58-8ff1-8399de5dd0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='806725c414614ec498615aed466996c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:15:47Z,use_quota=True,user_id='7c9bd0d3a90741718388f66af38fd95c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb3fa496-f9d1-4dcd-b337-b90d0dc52acd),volume_type_id=fb3fa496-f9d1-4dcd-b337-b90d0dc52acd)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Creating volume 9809ac18-1976-4c58-8ff1-8399de5dd0c0 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:15:47 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9809ac18-1976-4c58-8ff1-8399de5dd0c0 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:47 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9809ac18-1976-4c58-8ff1-8399de5dd0c0 1073741824 Jul 09 14:15:47 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:47 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_5u3b_j2s" returned: 1 in 1.034s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_5u3b_j2s' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ae446f-9fd4-42c7-abb4-9ec412e19b3f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:15:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_8b45vp5odevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:48 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_8b45vp5odevstack@QuobyteHD Jul 09 14:15:48 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:48 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9809ac18-1976-4c58-8ff1-8399de5dd0c0 1073741824" returned: 0 in 1.031s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9809ac18-1976-4c58-8ff1-8399de5dd0c0 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:48 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9809ac18-1976-4c58-8ff1-8399de5dd0c0 Jul 09 14:15:48 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:48 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_8b45vp5odevstack@QuobyteHD" returned: 0 in 0.913s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:48 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] fed42dad-a967-43d7-aa04-dfd40efa81d3 was qcow2, converting to raw {{(pid=87011) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 14:15:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_8b45vp5odevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:48 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_8b45vp5odevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 Jul 09 14:15:48 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:49 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9809ac18-1976-4c58-8ff1-8399de5dd0c0" returned: 0 in 0.967s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:49 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:15:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7b098b-4fbd-474d-8b3a-38141fe2a183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9809ac18-1976-4c58-8ff1-8399de5dd0c0', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5deb4156-ac1a-4d0c-b0ff-36b9615f99c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:49 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Volume volume-9809ac18-1976-4c58-8ff1-8399de5dd0c0 (9809ac18-1976-4c58-8ff1-8399de5dd0c0): created successfully Jul 09 14:15:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5deb4156-ac1a-4d0c-b0ff-36b9615f99c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Flow 'volume_create_manager' (c15eb9f9-3359-44a2-981b-25e24b0686fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:15:49 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d5ffa466-d1ac-4f18-9c2d-b8f5ce3d0c4c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Created volume successfully. Jul 09 14:15:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c79ad13a-3c11-426c-9986-1ac5e3d469f1 tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c79ad13a-3c11-426c-9986-1ac5e3d469f1 tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c79ad13a-3c11-426c-9986-1ac5e3d469f1 tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c79ad13a-3c11-426c-9986-1ac5e3d469f1 tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c79ad13a-3c11-426c-9986-1ac5e3d469f1 tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c79ad13a-3c11-426c-9986-1ac5e3d469f1 tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:51 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:15:51 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:51 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_8b45vp5odevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5" returned: 0 in 2.819s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:51 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_8b45vp5odevstack@QuobyteHD, size 112.00 MB, duration 2.82 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:15:51 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Converted 112.00 MB image at 39.71 MB/s Jul 09 14:15:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:51 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 1G Jul 09 14:15:51 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:52 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c79ad13a-3c11-426c-9986-1ac5e3d469f1 tempest-VolumeRetypeWithoutMigrationTest-872038370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.055s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:52 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-c79ad13a-3c11-426c-9986-1ac5e3d469f1 tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:15:52 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c79ad13a-3c11-426c-9986-1ac5e3d469f1 tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Retype volume completed successfully. Jul 09 14:15:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Acquiring lock "cinder-9809ac18-1976-4c58-8ff1-8399de5dd0c0-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:52 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Lock "cinder-9809ac18-1976-4c58-8ff1-8399de5dd0c0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 1G" returned: 0 in 0.906s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Acquiring lock "cinder-quobyte-9809ac18-1976-4c58-8ff1-8399de5dd0c0" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:52 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6472c6f-9263-4447-a361-6ac1201e66e2]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:15:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Lock "cinder-quobyte-9809ac18-1976-4c58-8ff1-8399de5dd0c0" acquired by "delete_volume" :: waited 0.061s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:52 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[52753d39-70ad-4108-a2e8-f96b6beba7ba]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:15:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9809ac18-1976-4c58-8ff1-8399de5dd0c0 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:52 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 Jul 09 14:15:52 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:53 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9809ac18-1976-4c58-8ff1-8399de5dd0c0 Jul 09 14:15:53 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:53 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5" returned: 0 in 1.059s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:53 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 Jul 09 14:15:53 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:54 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9809ac18-1976-4c58-8ff1-8399de5dd0c0" returned: 0 in 1.239s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9809ac18-1976-4c58-8ff1-8399de5dd0c0 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:54 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9809ac18-1976-4c58-8ff1-8399de5dd0c0 Jul 09 14:15:54 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:54 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9809ac18-1976-4c58-8ff1-8399de5dd0c0" returned: 0 in 0.778s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:54 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5" returned: 1 in 1.094s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:15:54 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Downloaded image fed42dad-a967-43d7-aa04-dfd40efa81d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}])) to volume a08065ce-b688-4064-8169-ccc2fec253d5 successfully. {{(pid=87011) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 14:15:54 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Temporary image fed42dad-a967-43d7-aa04-dfd40efa81d3 for user 36e3c3eeded3400280f98773260e4e2b is deleted. {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 14:15:54 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Marking volume a08065ce-b688-4064-8169-ccc2fec253d5 as bootable. {{(pid=87011) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 14:15:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Lock "cinder-quobyte-9809ac18-1976-4c58-8ff1-8399de5dd0c0" released by "delete_volume" :: held 2.118s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:54 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Copying metadata from image fed42dad-a967-43d7-aa04-dfd40efa81d3 to a08065ce-b688-4064-8169-ccc2fec253d5. {{(pid=87011) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 14:15:54 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Creating volume glance metadata for volume a08065ce-b688-4064-8169-ccc2fec253d5 backed by image fed42dad-a967-43d7-aa04-dfd40efa81d3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87011) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 14:15:54 devstack cinder-volume[87011]: WARNING cinder.quota [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:15:54 devstack cinder-volume[87011]: WARNING cinder.quota [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:15:55 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Created reservations ['14929775-da57-4d76-bbc8-f9bae09b51df', '4dd5be7b-0207-4307-942c-695ac7477eb4', '19c4fb72-7d88-42ac-b847-d9e3bda8d8ae', '064f1c94-8a7c-4113-a989-85be53e911cd'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:15:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38000ea7-6a9f-4218-8fe7-cf85efd21d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a08065ce-b688-4064-8169-ccc2fec253d5', 'volume_size': 1, 'image_id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c87c562978df4c18bad93b074708151d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'created_at': datetime.datetime(2026, 7, 9, 12, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fed42dad-a967-43d7-aa04-dfd40efa81d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16183445-d9f0-4ac1-93e2-24807488b0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:15:55 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Volume volume-a08065ce-b688-4064-8169-ccc2fec253d5 (a08065ce-b688-4064-8169-ccc2fec253d5): created successfully Jul 09 14:15:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16183445-d9f0-4ac1-93e2-24807488b0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:15:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Flow 'volume_create_manager' (09dd0dcf-55dd-4b94-aab9-4a6a2b458788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:15:55 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-2e83df8d-f874-4c23-8574-ae2c40544375 tempest-VolumesImageMetadata-981494550 None] Created volume successfully. Jul 09 14:15:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:55 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:15:55 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:55 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.669s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:55 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:15:55 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Deleted volume successfully. Jul 09 14:15:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cdc9eff3-5848-4bb2-8a11-787b20c35c3c tempest-VolumeRetypeWithoutMigrationTest-872038370 None] Lock "cinder-9809ac18-1976-4c58-8ff1-8399de5dd0c0-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] Acquiring lock "cinder-a08065ce-b688-4064-8169-ccc2fec253d5-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] Lock "cinder-a08065ce-b688-4064-8169-ccc2fec253d5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] Acquiring lock "cinder-quobyte-a08065ce-b688-4064-8169-ccc2fec253d5" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:15:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] Lock "cinder-quobyte-a08065ce-b688-4064-8169-ccc2fec253d5" acquired by "delete_volume" :: waited 0.014s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:15:56 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6926ae29-c347-461f-baa7-377265616041]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:15:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:56 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 Jul 09 14:15:56 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:57 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5" returned: 0 in 0.846s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:57 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 Jul 09 14:15:57 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:58 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5" returned: 1 in 0.910s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:15:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:58 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5 Jul 09 14:15:58 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:15:59 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Jul 09 14:15:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a08065ce-b688-4064-8169-ccc2fec253d5" returned: 0 in 0.762s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:15:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] Lock "cinder-quobyte-a08065ce-b688-4064-8169-ccc2fec253d5" released by "delete_volume" :: held 2.601s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:15:59 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] Created reservations ['5683fa41-c12c-4561-a34e-64ec20ef9ad4', 'b5dde0b3-dc28-428c-8a21-9135498a522e', '3dbb77bf-af84-4e65-b24f-e8af806a55c8', 'dda3bbf3-f057-4efe-8686-437b73e9dadf'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:15:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:15:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:15:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:15:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:15:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:15:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:15:59 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:15:59 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:00 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.762s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:00 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:16:00 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] Deleted volume successfully. Jul 09 14:16:00 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ebb8eb02-1d45-458c-a0e1-ab0291ddc529 tempest-VolumesImageMetadata-981494550 None] Lock "cinder-a08065ce-b688-4064-8169-ccc2fec253d5-delete_volume" released by "delete_volume" :: held 3.646s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Flow 'volume_create_manager' (6ebb87c6-91df-4a3f-8584-9d1f91caf314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbe1387-e635-4364-89c0-f321e9fa5d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbe1387-e635-4364-89c0-f321e9fa5d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-574527688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a53332e-2c92-46c6-89f3-afaa95d41f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0addf440124a928753c3066a001c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:03Z,use_quota=True,user_id='97a4960bf16e41ccaf30951ae5a36504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88db7481-69c9-45c9-9b25-dd347c446cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88db7481-69c9-45c9-9b25-dd347c446cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1135a22-9c63-4514-97e7-13634bd11cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1135a22-9c63-4514-97e7-13634bd11cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a53332e-2c92-46c6-89f3-afaa95d41f59', 'volume_name': 'volume-5a53332e-2c92-46c6-89f3-afaa95d41f59', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2da6fe-9958-4d54-acf0-92359a994b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2da6fe-9958-4d54-acf0-92359a994b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153abeaa-2d21-4e44-9439-9e9d40187cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:03 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Volume 5a53332e-2c92-46c6-89f3-afaa95d41f59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a53332e-2c92-46c6-89f3-afaa95d41f59', 'volume_size': 1} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-574527688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a53332e-2c92-46c6-89f3-afaa95d41f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0addf440124a928753c3066a001c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:03Z,use_quota=True,user_id='97a4960bf16e41ccaf30951ae5a36504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Creating volume 5a53332e-2c92-46c6-89f3-afaa95d41f59 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:16:03 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:16:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5a53332e-2c92-46c6-89f3-afaa95d41f59 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:03 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5a53332e-2c92-46c6-89f3-afaa95d41f59 1073741824 Jul 09 14:16:03 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Flow 'volume_create_manager' (d870d45b-a1c9-439e-bd74-6e851eba6a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce45a648-7cee-4068-a1bb-4069993e8b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce45a648-7cee-4068-a1bb-4069993e8b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1456662303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843bf8a1-b9ac-44aa-b491-6522f93cd642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46dbe705de47412684e79a8d151b378b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:04Z,use_quota=True,user_id='a48d7393127740b288222e0b2fecd604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f79fee-b20d-4677-9f06-9ccfd00ef319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:04 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f79fee-b20d-4677-9f06-9ccfd00ef319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8faf6c73-f0e3-4316-b424-bcb99f62c0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8faf6c73-f0e3-4316-b424-bcb99f62c0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '843bf8a1-b9ac-44aa-b491-6522f93cd642', 'volume_name': 'volume-843bf8a1-b9ac-44aa-b491-6522f93cd642', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc37cefd-4487-432e-b232-06d881e8a6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc37cefd-4487-432e-b232-06d881e8a6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f26211d-d4ee-4958-8a96-58048cb08610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:04 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Volume 843bf8a1-b9ac-44aa-b491-6522f93cd642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-843bf8a1-b9ac-44aa-b491-6522f93cd642', 'volume_size': 1} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5a53332e-2c92-46c6-89f3-afaa95d41f59 1073741824" returned: 0 in 1.000s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Flow 'volume_create_manager' (8aa4867d-676f-4b91-bba9-a0c1b6c87d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b09eef8-93c7-486d-9883-e2c8ee1bac54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b09eef8-93c7-486d-9883-e2c8ee1bac54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-260133776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e140cf65-31b7-4432-b187-3dd5a9841e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49ab6bd0fb34c478b305c1deea0446b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:04Z,use_quota=True,user_id='67692433143c47f8b67c50b392466031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b095dc5-ebc0-4d11-8c2c-2edaf66b603b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b095dc5-ebc0-4d11-8c2c-2edaf66b603b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95caf60d-ab30-4827-8130-affa322bdd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95caf60d-ab30-4827-8130-affa322bdd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e140cf65-31b7-4432-b187-3dd5a9841e7c', 'volume_name': 'volume-e140cf65-31b7-4432-b187-3dd5a9841e7c', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2099b6-fab8-4020-98f2-fc206aac9859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2099b6-fab8-4020-98f2-fc206aac9859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73159fe-e33f-4f94-a655-849459e4a933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:04 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Volume e140cf65-31b7-4432-b187-3dd5a9841e7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e140cf65-31b7-4432-b187-3dd5a9841e7c', 'volume_size': 1} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5a53332e-2c92-46c6-89f3-afaa95d41f59 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:04 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5a53332e-2c92-46c6-89f3-afaa95d41f59 Jul 09 14:16:04 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:05 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5a53332e-2c92-46c6-89f3-afaa95d41f59" returned: 0 in 0.674s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.793s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1456662303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843bf8a1-b9ac-44aa-b491-6522f93cd642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46dbe705de47412684e79a8d151b378b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:04Z,use_quota=True,user_id='a48d7393127740b288222e0b2fecd604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Creating volume 843bf8a1-b9ac-44aa-b491-6522f93cd642 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:16:05 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:05 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642 1073741824 Jul 09 14:16:05 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153abeaa-2d21-4e44-9439-9e9d40187cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a53332e-2c92-46c6-89f3-afaa95d41f59', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13971155-8236-4be7-a459-acde9cff350a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:05 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Volume volume-5a53332e-2c92-46c6-89f3-afaa95d41f59 (5a53332e-2c92-46c6-89f3-afaa95d41f59): created successfully Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13971155-8236-4be7-a459-acde9cff350a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Flow 'volume_create_manager' (6ebb87c6-91df-4a3f-8584-9d1f91caf314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:05 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-7b57e4de-6730-4d3b-b09b-1b9d0e597661 tempest-VolumesListAdminTestJSON-1412553622 None] Created volume successfully. Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Flow 'volume_create_manager' (aa5f33ce-e2c7-482e-8be7-52c798f379ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e8a4289-cff3-4aea-82ef-28981c1d6e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e8a4289-cff3-4aea-82ef-28981c1d6e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1952999548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31353ebd-f4c1-4d96-9337-fa6ce5aeab7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0addf440124a928753c3066a001c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:06Z,use_quota=True,user_id='97a4960bf16e41ccaf30951ae5a36504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b68e06e-37bd-4e9b-a56d-135ddaf9374f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b68e06e-37bd-4e9b-a56d-135ddaf9374f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7485e86c-3d43-4e7f-983b-fed577e4575c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7485e86c-3d43-4e7f-983b-fed577e4575c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31353ebd-f4c1-4d96-9337-fa6ce5aeab7f', 'volume_name': 'volume-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703037bc-59b7-425e-b244-087c65af9efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703037bc-59b7-425e-b244-087c65af9efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5857644d-c278-4211-99c1-1743afdd3bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:06 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Volume 31353ebd-f4c1-4d96-9337-fa6ce5aeab7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f', 'volume_size': 1} Jul 09 14:16:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:06 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642 1073741824" returned: 0 in 0.940s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:06 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642 Jul 09 14:16:06 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:07 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642" returned: 0 in 0.847s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:16:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.526s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-260133776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e140cf65-31b7-4432-b187-3dd5a9841e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49ab6bd0fb34c478b305c1deea0446b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:04Z,use_quota=True,user_id='67692433143c47f8b67c50b392466031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:16:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Creating volume e140cf65-31b7-4432-b187-3dd5a9841e7c {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:16:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:16:07 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:16:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:07 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c 1073741824 Jul 09 14:16:07 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f26211d-d4ee-4958-8a96-58048cb08610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-843bf8a1-b9ac-44aa-b491-6522f93cd642', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f91f7d39-b8e6-412a-8694-c457472eaf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:07 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Volume volume-843bf8a1-b9ac-44aa-b491-6522f93cd642 (843bf8a1-b9ac-44aa-b491-6522f93cd642): created successfully Jul 09 14:16:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f91f7d39-b8e6-412a-8694-c457472eaf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Flow 'volume_create_manager' (d870d45b-a1c9-439e-bd74-6e851eba6a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:07 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-2d54412e-43d1-4511-b3d5-21fb3d4f7477 tempest-SnapshotMetadataTestJSON-1162016163 None] Created volume successfully. Jul 09 14:16:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:08 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c 1073741824" returned: 0 in 1.028s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:08 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c Jul 09 14:16:08 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:08 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c" returned: 0 in 0.634s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.678s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1952999548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31353ebd-f4c1-4d96-9337-fa6ce5aeab7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0addf440124a928753c3066a001c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:06Z,use_quota=True,user_id='97a4960bf16e41ccaf30951ae5a36504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Creating volume 31353ebd-f4c1-4d96-9337-fa6ce5aeab7f {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:16:08 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:08 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f 1073741824 Jul 09 14:16:08 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73159fe-e33f-4f94-a655-849459e4a933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e140cf65-31b7-4432-b187-3dd5a9841e7c', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac14ac1-c6cc-48db-9512-98cca7e663e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:08 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Volume volume-e140cf65-31b7-4432-b187-3dd5a9841e7c (e140cf65-31b7-4432-b187-3dd5a9841e7c): created successfully Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac14ac1-c6cc-48db-9512-98cca7e663e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Flow 'volume_create_manager' (8aa4867d-676f-4b91-bba9-a0c1b6c87d52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:08 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-fa39e74d-7e97-4136-a2e3-fe25d12428e4 tempest-VolumesDeleteCascade-1326290886 None] Created volume successfully. Jul 09 14:16:09 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f 1073741824" returned: 0 in 0.856s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:09 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f Jul 09 14:16:09 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:10 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f" returned: 0 in 0.632s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:16:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.713s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5857644d-c278-4211-99c1-1743afdd3bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fcc541f-41e7-4fb6-95eb-e83aeaedc83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] Creating offline snapshot 45339cda-cd71-4e8c-86fd-744e254b43cb of volume 843bf8a1-b9ac-44aa-b491-6522f93cd642 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:16:10 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Volume volume-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f (31353ebd-f4c1-4d96-9337-fa6ce5aeab7f): created successfully Jul 09 14:16:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fcc541f-41e7-4fb6-95eb-e83aeaedc83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Flow 'volume_create_manager' (aa5f33ce-e2c7-482e-8be7-52c798f379ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:10 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f33d092-ca1c-4118-9e6a-4429825dde04]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:10 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-dc14a9d0-d700-4cb7-88ef-03a4d4679425 tempest-VolumesListAdminTestJSON-1412553622 None] Created volume successfully. Jul 09 14:16:10 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642 Jul 09 14:16:10 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:11 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642" returned: 0 in 0.750s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:11 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb 1G Jul 09 14:16:11 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:11 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:16:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Flow 'volume_create_manager' (383dd898-d2c3-40eb-bd5b-1842aa85ee63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (259745dd-559e-4db1-85e0-3c217817b30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (259745dd-559e-4db1-85e0-3c217817b30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1299736334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7679f762-6134-4349-b723-4acf47902d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0addf440124a928753c3066a001c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:12Z,use_quota=True,user_id='97a4960bf16e41ccaf30951ae5a36504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b40594-e942-4f4a-b777-a407b14ad581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b40594-e942-4f4a-b777-a407b14ad581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a0345e-afb2-403d-9939-56a0bbdc8f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a0345e-afb2-403d-9939-56a0bbdc8f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7679f762-6134-4349-b723-4acf47902d52', 'volume_name': 'volume-7679f762-6134-4349-b723-4acf47902d52', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10496896-9846-46fc-9a8a-faf17b1e4f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10496896-9846-46fc-9a8a-faf17b1e4f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5535ba-d496-4987-b7b2-30f9310096ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:11 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Volume 7679f762-6134-4349-b723-4acf47902d52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7679f762-6134-4349-b723-4acf47902d52', 'volume_size': 1} Jul 09 14:16:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:11 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb 1G" returned: 0 in 0.854s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843bf8a1-b9ac-44aa-b491-6522f93cd642 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:11 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843bf8a1-b9ac-44aa-b491-6522f93cd642 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb Jul 09 14:16:11 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:16:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:12 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:16:12 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:12 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843bf8a1-b9ac-44aa-b491-6522f93cd642 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb" returned: 0 in 0.708s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:12 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb is being set with open permissions: ugo+rw Jul 09 14:16:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:12 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb Jul 09 14:16:12 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:13 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.707s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:16:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:16:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:16:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:16:13 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb" returned: 0 in 0.726s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:13 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.info Jul 09 14:16:13 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:14 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.info" returned: 0 in 0.675s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:14 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.info is being set with open permissions: ugo+rw Jul 09 14:16:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:14 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.info Jul 09 14:16:14 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:14 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.info" returned: 0 in 0.651s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.483s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.055s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] Creating offline snapshot 0c9967b6-bafd-4100-962a-7a4071994840 of volume e140cf65-31b7-4432-b187-3dd5a9841e7c {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:16:14 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ec0672e3-1255-4366-b0b8-d3bac2941a67 tempest-SnapshotMetadataTestJSON-1162016163 None] Create snapshot completed successfully Jul 09 14:16:14 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fca496a-7ad0-475d-af4e-92fb67896ef0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:14 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c Jul 09 14:16:14 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:15 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c" returned: 0 in 0.786s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:15 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 1G Jul 09 14:16:15 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:16 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 1G" returned: 0 in 0.881s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e140cf65-31b7-4432-b187-3dd5a9841e7c -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:16 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e140cf65-31b7-4432-b187-3dd5a9841e7c -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 Jul 09 14:16:16 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] Acquiring lock "cinder-45339cda-cd71-4e8c-86fd-744e254b43cb-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] Lock "cinder-45339cda-cd71-4e8c-86fd-744e254b43cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] Acquiring lock "cinder-quobyte-843bf8a1-b9ac-44aa-b491-6522f93cd642" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] Lock "cinder-quobyte-843bf8a1-b9ac-44aa-b491-6522f93cd642" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] Acquiring lock "cinder-quobyte-45339cda-cd71-4e8c-86fd-744e254b43cb" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] Lock "cinder-quobyte-45339cda-cd71-4e8c-86fd-744e254b43cb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] Deleting offline snapshot 45339cda-cd71-4e8c-86fd-744e254b43cb of volume 843bf8a1-b9ac-44aa-b491-6522f93cd642 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:16:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] snapshot_file for this snap is: volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:16:16 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc3e965-821d-4a5a-a5ba-800d21f6eb50]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:16 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb Jul 09 14:16:16 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:17 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e140cf65-31b7-4432-b187-3dd5a9841e7c -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840" returned: 0 in 0.703s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:17 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 is being set with open permissions: ugo+rw Jul 09 14:16:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:17 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 Jul 09 14:16:17 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:17 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb" returned: 0 in 0.795s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843bf8a1-b9ac-44aa-b491-6522f93cd642(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:16:17 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ed6925-da23-48d2-afa9-904522e21f3b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:17 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642 Jul 09 14:16:17 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:17 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840" returned: 0 in 0.647s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:17 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.info Jul 09 14:16:17 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:18 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642" returned: 0 in 0.768s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:18 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb Jul 09 14:16:18 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:18 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.info" returned: 0 in 0.642s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:18 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.info is being set with open permissions: ugo+rw Jul 09 14:16:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:18 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.info Jul 09 14:16:18 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:19 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb" returned: 0 in 0.816s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:19 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:19 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.info" returned: 0 in 0.637s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:19 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.424s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.328s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1299736334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7679f762-6134-4349-b723-4acf47902d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf0addf440124a928753c3066a001c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:12Z,use_quota=True,user_id='97a4960bf16e41ccaf30951ae5a36504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Creating volume 7679f762-6134-4349-b723-4acf47902d52 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:16:19 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7679f762-6134-4349-b723-4acf47902d52 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:19 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7679f762-6134-4349-b723-4acf47902d52 1073741824 Jul 09 14:16:19 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:19 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ee27548c-a21b-4a0a-9146-cdda92fbf5d8 tempest-VolumesDeleteCascade-1326290886 None] Create snapshot completed successfully Jul 09 14:16:19 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642.45339cda-cd71-4e8c-86fd-744e254b43cb" returned: 0 in 0.630s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] Lock "cinder-quobyte-45339cda-cd71-4e8c-86fd-744e254b43cb" released by "_delete_snapshot" :: held 3.131s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] Lock "cinder-quobyte-843bf8a1-b9ac-44aa-b491-6522f93cd642" released by "delete_snapshot" :: held 3.160s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] Created reservations ['4619f8e2-7414-43cb-a760-4a5242ef3548', 'c4299d10-9efe-4aa2-8790-4c4326da3290', 'a6117d40-298d-4719-9fea-cfa031f987ea', 'e50c835c-0e50-4c78-8a03-373394e007ed'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:16:19 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] Delete snapshot completed successfully. Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c17421be-b44f-4439-9d6c-ba8baf8d6151 tempest-SnapshotMetadataTestJSON-1162016163 None] Lock "cinder-45339cda-cd71-4e8c-86fd-744e254b43cb-delete_snapshot" released by "delete_snapshot" :: held 3.294s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:19 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7679f762-6134-4349-b723-4acf47902d52 1073741824" returned: 0 in 0.804s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7679f762-6134-4349-b723-4acf47902d52 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:20 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7679f762-6134-4349-b723-4acf47902d52 Jul 09 14:16:20 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d392dc35-09af-49ad-a255-c55afcfab417 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:20 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7679f762-6134-4349-b723-4acf47902d52" returned: 0 in 0.676s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:16:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d392dc35-09af-49ad-a255-c55afcfab417 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.304s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5535ba-d496-4987-b7b2-30f9310096ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7679f762-6134-4349-b723-4acf47902d52', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca7f446-a84b-4064-851f-33f8b1ca1b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d392dc35-09af-49ad-a255-c55afcfab417 tempest-VolumesDeleteCascade-1326290886 None] Creating offline snapshot 800d903f-db02-4c96-b353-3335b16ff240 of volume e140cf65-31b7-4432-b187-3dd5a9841e7c {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:16:20 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Volume volume-7679f762-6134-4349-b723-4acf47902d52 (7679f762-6134-4349-b723-4acf47902d52): created successfully Jul 09 14:16:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca7f446-a84b-4064-851f-33f8b1ca1b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Flow 'volume_create_manager' (383dd898-d2c3-40eb-bd5b-1842aa85ee63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:20 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b44d887-4f6f-412c-9ac4-a3584ea694f2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d392dc35-09af-49ad-a255-c55afcfab417 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:20 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-69cd0a95-fd0a-4247-878f-8f038a5e3eca tempest-VolumesListAdminTestJSON-1412553622 None] Created volume successfully. Jul 09 14:16:20 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] Acquiring lock "cinder-843bf8a1-b9ac-44aa-b491-6522f93cd642-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:20 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] Lock "cinder-843bf8a1-b9ac-44aa-b491-6522f93cd642-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:20 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 Jul 09 14:16:20 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] Acquiring lock "cinder-quobyte-843bf8a1-b9ac-44aa-b491-6522f93cd642" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] Lock "cinder-quobyte-843bf8a1-b9ac-44aa-b491-6522f93cd642" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:21 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9301666-32ab-4669-9e5d-26f00f47735a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:21 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642 Jul 09 14:16:21 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:21 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d392dc35-09af-49ad-a255-c55afcfab417 tempest-VolumesDeleteCascade-1326290886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840" returned: 0 in 1.073s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d392dc35-09af-49ad-a255-c55afcfab417 tempest-VolumesDeleteCascade-1326290886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e140cf65-31b7-4432-b187-3dd5a9841e7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:16:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d392dc35-09af-49ad-a255-c55afcfab417 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:21 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 1G Jul 09 14:16:21 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:22 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642" returned: 0 in 1.107s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:22 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642 Jul 09 14:16:22 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:22 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:16:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Flow 'volume_create_manager' (7aa97e23-1531-43db-8c82-7008b3f51b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1265f9-20f6-4eb1-8b5a-e22d25fdfbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1265f9-20f6-4eb1-8b5a-e22d25fdfbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949af7f4-3024-4ee5-8002-d35295e86e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2ff687807544e8a03421b65c75f4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:22Z,use_quota=True,user_id='abfae9a661db4203bd9fc62920c70478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2696741-37ff-4b5d-b658-90dc69c65659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2696741-37ff-4b5d-b658-90dc69c65659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084dbc24-5529-4df1-97b0-9c0e01a8c9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084dbc24-5529-4df1-97b0-9c0e01a8c9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '949af7f4-3024-4ee5-8002-d35295e86e98', 'volume_name': 'volume-949af7f4-3024-4ee5-8002-d35295e86e98', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a16e82-412f-4d42-ad64-75462d55ef2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a16e82-412f-4d42-ad64-75462d55ef2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748807b1-1506-4d65-8ea2-94a6b2833087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:22 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Volume 949af7f4-3024-4ee5-8002-d35295e86e98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-949af7f4-3024-4ee5-8002-d35295e86e98', 'volume_size': 1} Jul 09 14:16:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:23 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-843bf8a1-b9ac-44aa-b491-6522f93cd642" returned: 0 in 0.841s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:23 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] Lock "cinder-quobyte-843bf8a1-b9ac-44aa-b491-6522f93cd642" released by "delete_volume" :: held 2.020s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:23 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d392dc35-09af-49ad-a255-c55afcfab417 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 1G" returned: 0 in 1.163s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d392dc35-09af-49ad-a255-c55afcfab417 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:23 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 Jul 09 14:16:23 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:23 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] Created reservations ['5b63b540-d0de-4f1e-8073-25b6e114a947', 'c6ce20ce-134e-4be6-9cad-3f7db23b2607', 'a606a471-959f-445a-b508-8692e994b6f1', 'f7d8572c-429a-4bb0-9bd5-38c8521015f5'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:16:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:23 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:16:23 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:23 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d392dc35-09af-49ad-a255-c55afcfab417 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240" returned: 0 in 0.708s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:23 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-d392dc35-09af-49ad-a255-c55afcfab417 tempest-VolumesDeleteCascade-1326290886 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 is being set with open permissions: ugo+rw Jul 09 14:16:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d392dc35-09af-49ad-a255-c55afcfab417 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:23 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 Jul 09 14:16:23 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:23 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.638s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:23 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:16:23 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] Deleted volume successfully. Jul 09 14:16:23 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-baf40afd-6fb9-4622-ba03-4493f0a78fc5 tempest-SnapshotMetadataTestJSON-1162016163 None] Lock "cinder-843bf8a1-b9ac-44aa-b491-6522f93cd642-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:24 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d392dc35-09af-49ad-a255-c55afcfab417 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240" returned: 0 in 0.627s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d392dc35-09af-49ad-a255-c55afcfab417 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.722s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.841s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949af7f4-3024-4ee5-8002-d35295e86e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2ff687807544e8a03421b65c75f4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:22Z,use_quota=True,user_id='abfae9a661db4203bd9fc62920c70478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Creating volume 949af7f4-3024-4ee5-8002-d35295e86e98 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:16:24 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-949af7f4-3024-4ee5-8002-d35295e86e98 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:24 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-949af7f4-3024-4ee5-8002-d35295e86e98 1073741824 Jul 09 14:16:24 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:24 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d392dc35-09af-49ad-a255-c55afcfab417 tempest-VolumesDeleteCascade-1326290886 None] Create snapshot completed successfully Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "cinder-e140cf65-31b7-4432-b187-3dd5a9841e7c-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-e140cf65-31b7-4432-b187-3dd5a9841e7c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Performing cascade delete. {{(pid=87011) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "cinder-0c9967b6-bafd-4100-962a-7a4071994840-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-0c9967b6-bafd-4100-962a-7a4071994840-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "cinder-quobyte-e140cf65-31b7-4432-b187-3dd5a9841e7c" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-e140cf65-31b7-4432-b187-3dd5a9841e7c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "cinder-quobyte-0c9967b6-bafd-4100-962a-7a4071994840" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-0c9967b6-bafd-4100-962a-7a4071994840" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Deleting offline snapshot 0c9967b6-bafd-4100-962a-7a4071994840 of volume e140cf65-31b7-4432-b187-3dd5a9841e7c {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] snapshot_file for this snap is: volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0cb7c0-f65f-4f18-9084-229ec791462e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:25 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 Jul 09 14:16:25 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:25 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-949af7f4-3024-4ee5-8002-d35295e86e98 1073741824" returned: 0 in 1.031s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-949af7f4-3024-4ee5-8002-d35295e86e98 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:25 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-949af7f4-3024-4ee5-8002-d35295e86e98 Jul 09 14:16:25 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:25 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840" returned: 0 in 0.969s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e140cf65-31b7-4432-b187-3dd5a9841e7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:16:25 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cab8959-d6df-4f7c-b8e6-8ce556039243]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:26 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c Jul 09 14:16:26 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:26 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-949af7f4-3024-4ee5-8002-d35295e86e98" returned: 0 in 0.841s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:16:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748807b1-1506-4d65-8ea2-94a6b2833087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-949af7f4-3024-4ee5-8002-d35295e86e98', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db8e0b3-2937-46b5-9eaf-a6b2a4b0cd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:26 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Volume volume-949af7f4-3024-4ee5-8002-d35295e86e98 (949af7f4-3024-4ee5-8002-d35295e86e98): created successfully Jul 09 14:16:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db8e0b3-2937-46b5-9eaf-a6b2a4b0cd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Flow 'volume_create_manager' (7aa97e23-1531-43db-8c82-7008b3f51b3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:26 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ab31cea9-7bde-41a8-bc41-2e774b2f7f59 tempest-VolumesListAdminTestJSON-550727254 None] Created volume successfully. Jul 09 14:16:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] Acquiring lock "cinder-949af7f4-3024-4ee5-8002-d35295e86e98-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] Lock "cinder-949af7f4-3024-4ee5-8002-d35295e86e98-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] Acquiring lock "cinder-quobyte-949af7f4-3024-4ee5-8002-d35295e86e98" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] Lock "cinder-quobyte-949af7f4-3024-4ee5-8002-d35295e86e98" acquired by "delete_volume" :: waited 0.064s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:27 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2d9e3a-46a2-4b78-83cd-b6d6c8cc4600]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-949af7f4-3024-4ee5-8002-d35295e86e98 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] Acquiring lock "cinder-7679f762-6134-4349-b723-4acf47902d52-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:27 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c" returned: 0 in 1.432s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] Lock "cinder-7679f762-6134-4349-b723-4acf47902d52-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:27 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cf871c-4612-4c6a-b33b-843ecdf8e2dd]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:27 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-949af7f4-3024-4ee5-8002-d35295e86e98 Jul 09 14:16:27 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] Acquiring lock "cinder-quobyte-7679f762-6134-4349-b723-4acf47902d52" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] Lock "cinder-quobyte-7679f762-6134-4349-b723-4acf47902d52" acquired by "delete_volume" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:27 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e51ed65-fcd3-4a5e-97cd-be79eab4caaa]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7679f762-6134-4349-b723-4acf47902d52 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:27 devstack sudo[96396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 Jul 09 14:16:27 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:27 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7679f762-6134-4349-b723-4acf47902d52 Jul 09 14:16:27 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:28 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-949af7f4-3024-4ee5-8002-d35295e86e98" returned: 0 in 1.071s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-949af7f4-3024-4ee5-8002-d35295e86e98 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:28 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-949af7f4-3024-4ee5-8002-d35295e86e98 Jul 09 14:16:28 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:28 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240" returned: 0 in 1.138s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e140cf65-31b7-4432-b187-3dd5a9841e7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:16:28 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb9dd2a-c7f3-4e1a-866b-3a43d79332e3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:28 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 Jul 09 14:16:28 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:28 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7679f762-6134-4349-b723-4acf47902d52" returned: 0 in 1.382s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7679f762-6134-4349-b723-4acf47902d52 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:28 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7679f762-6134-4349-b723-4acf47902d52 Jul 09 14:16:28 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:29 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-949af7f4-3024-4ee5-8002-d35295e86e98" returned: 0 in 1.098s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] Lock "cinder-quobyte-949af7f4-3024-4ee5-8002-d35295e86e98" released by "delete_volume" :: held 2.306s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:29 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] Created reservations ['25f9bc8a-1a24-4b3f-9948-ea5212238a1b', '9276fd6f-2c42-4222-9430-9ad5d93e7e52', '9391722a-e508-4a6f-a9e5-267cf0ecba34', 'bad9ffd1-2366-4eee-9284-4cad714a0f78'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:16:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:29 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:16:29 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:29 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7679f762-6134-4349-b723-4acf47902d52" returned: 0 in 1.057s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:29 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840" returned: 0 in 1.389s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e140cf65-31b7-4432-b187-3dd5a9841e7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:16:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] Lock "cinder-quobyte-7679f762-6134-4349-b723-4acf47902d52" released by "delete_volume" :: held 2.501s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:30 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[65920210-04f2-4209-a1a8-16dd213cbe55]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:30 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] Created reservations ['54f9ec12-532f-45dd-9a88-d82fe8af30a0', 'f5a755bf-4e44-41fa-bdf6-14af6919cda2', '4615123d-870a-482e-a176-b4666877d649', '36743add-2579-4bcc-855e-590f615a2f7c'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:16:30 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c Jul 09 14:16:30 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:30 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:30 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:30 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:16:30 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] Acquiring lock "cinder-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "cinder-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:31 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:INSERT=26,cinder:UPDATE=109,cinder:SELECT=92,cinder:DELETE=7 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:16:31 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=88,cinder:INSERT=35,cinder:UPDATE=111,cinder:DELETE=12 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:16:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] Acquiring lock "cinder-quobyte-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "cinder-quobyte-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f" acquired by "delete_volume" :: waited 0.041s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:31 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23edb92-8ef3-4965-bd38-7c27312478e1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:31 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.572s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:31 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:16:31 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] Deleted volume successfully. Jul 09 14:16:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a20f1747-274f-412d-a94d-3c9338f43190 tempest-VolumesListAdminTestJSON-550727254 None] Lock "cinder-949af7f4-3024-4ee5-8002-d35295e86e98-delete_volume" released by "delete_volume" :: held 4.293s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:31 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f Jul 09 14:16:31 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:31 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.157s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:31 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:16:31 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] Deleted volume successfully. Jul 09 14:16:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad9f1a6f-90a2-4c7d-b06c-33225b23388b tempest-VolumesListAdminTestJSON-1412553622 None] Lock "cinder-7679f762-6134-4349-b723-4acf47902d52-delete_volume" released by "delete_volume" :: held 4.153s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:31 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c" returned: 0 in 1.739s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:31 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 Jul 09 14:16:31 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:32 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f" returned: 0 in 1.672s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:32 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f Jul 09 14:16:32 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:32 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840" returned: 0 in 1.205s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:33 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840 Jul 09 14:16:33 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:34 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.0c9967b6-bafd-4100-962a-7a4071994840" returned: 0 in 1.077s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e140cf65-31b7-4432-b187-3dd5a9841e7c /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 -F qcow2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:34 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e140cf65-31b7-4432-b187-3dd5a9841e7c /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 -F qcow2 Jul 09 14:16:34 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:34 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f" returned: 0 in 1.236s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "cinder-quobyte-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f" released by "delete_volume" :: held 3.006s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:34 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] Created reservations ['273aa96b-f942-4878-bfd8-3b6b6d22936e', '059977ff-6058-4197-abb8-e6841056a517', 'b82511cd-0d3d-440a-b71a-f64c62b6d35f', '1d02c46f-00a1-4a74-b674-a401a941d2dc'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:16:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:34 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:16:34 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] Acquiring lock "cinder-5a53332e-2c92-46c6-89f3-afaa95d41f59-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "cinder-5a53332e-2c92-46c6-89f3-afaa95d41f59-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] Acquiring lock "cinder-quobyte-5a53332e-2c92-46c6-89f3-afaa95d41f59" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "cinder-quobyte-5a53332e-2c92-46c6-89f3-afaa95d41f59" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:34 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7dc482-57d7-4486-8060-36e19672cffa]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5a53332e-2c92-46c6-89f3-afaa95d41f59 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:35 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5a53332e-2c92-46c6-89f3-afaa95d41f59 Jul 09 14:16:35 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:35 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e140cf65-31b7-4432-b187-3dd5a9841e7c /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 -F qcow2" returned: 0 in 1.229s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-0c9967b6-bafd-4100-962a-7a4071994840" released by "_delete_snapshot" :: held 10.464s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-e140cf65-31b7-4432-b187-3dd5a9841e7c" released by "delete_snapshot" :: held 10.497s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:35 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Created reservations ['9edc08b2-e645-46ec-9658-4d51a6bb5348', 'fe6828f8-65da-42f9-b4bb-06bd396f6bf9', '81145895-3211-45a4-a590-4a751c46781d', 'c9f35b09-d366-43bf-9964-ab0f3b0a4aac'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:16:35 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Delete snapshot completed successfully. Jul 09 14:16:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-0c9967b6-bafd-4100-962a-7a4071994840-delete_snapshot" released by "delete_snapshot" :: held 10.770s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "cinder-800d903f-db02-4c96-b353-3335b16ff240-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-800d903f-db02-4c96-b353-3335b16ff240-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "cinder-quobyte-e140cf65-31b7-4432-b187-3dd5a9841e7c" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-e140cf65-31b7-4432-b187-3dd5a9841e7c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "cinder-quobyte-800d903f-db02-4c96-b353-3335b16ff240" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-800d903f-db02-4c96-b353-3335b16ff240" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Deleting offline snapshot 800d903f-db02-4c96-b353-3335b16ff240 of volume e140cf65-31b7-4432-b187-3dd5a9841e7c {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:16:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] snapshot_file for this snap is: volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:16:35 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe55389b-aa27-4df8-9799-7d6e432965fa]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:35 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.539s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:35 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:16:35 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] Deleted volume successfully. Jul 09 14:16:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e98401c8-9d19-4934-974b-94f48f349629 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "cinder-31353ebd-f4c1-4d96-9337-fa6ce5aeab7f-delete_volume" released by "delete_volume" :: held 4.972s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:36 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 Jul 09 14:16:36 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:36 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5a53332e-2c92-46c6-89f3-afaa95d41f59" returned: 0 in 1.489s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5a53332e-2c92-46c6-89f3-afaa95d41f59 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:36 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5a53332e-2c92-46c6-89f3-afaa95d41f59 Jul 09 14:16:36 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:37 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5a53332e-2c92-46c6-89f3-afaa95d41f59" returned: 0 in 0.944s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "cinder-quobyte-5a53332e-2c92-46c6-89f3-afaa95d41f59" released by "delete_volume" :: held 2.494s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:37 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240" returned: 0 in 1.685s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e140cf65-31b7-4432-b187-3dd5a9841e7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:16:37 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2935600-97d0-41ee-b36d-ab3a47b31fd0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:37 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] Created reservations ['877a2625-9133-485f-950d-6cb7a97e4d56', '0cd6fba6-9dba-4ed2-acf6-bf5eb2d74f46', 'f2f10b40-67dd-42b6-8b90-fd42fc5af389', 'f5a68997-8286-4f1b-901a-d957c3ca0a75'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:16:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:37 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:16:37 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:37 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c Jul 09 14:16:37 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:38 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.032s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:38 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:16:38 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] Deleted volume successfully. Jul 09 14:16:38 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-aa94e07c-0898-46db-96b8-f91bbf736ef0 tempest-VolumesListAdminTestJSON-1412553622 None] Lock "cinder-5a53332e-2c92-46c6-89f3-afaa95d41f59-delete_volume" released by "delete_volume" :: held 3.959s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:39 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c" returned: 0 in 1.625s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:39 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 Jul 09 14:16:39 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:40 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240" returned: 0 in 1.439s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:40 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240 Jul 09 14:16:40 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:41 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c.800d903f-db02-4c96-b353-3335b16ff240" returned: 0 in 1.199s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:41 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-800d903f-db02-4c96-b353-3335b16ff240" released by "_delete_snapshot" :: held 6.122s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:41 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-e140cf65-31b7-4432-b187-3dd5a9841e7c" released by "delete_snapshot" :: held 6.174s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:41 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Created reservations ['7d961fb0-7642-42ef-8dcc-e2dde2056dd2', '39122794-2054-489a-8e56-519c39739cae', 'bad8e4c7-1224-47b9-99d0-d435b817ecd8', '3cbd0f52-b846-4708-95ec-d7b3b8e5b6b2'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:16:42 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Delete snapshot completed successfully. Jul 09 14:16:42 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-800d903f-db02-4c96-b353-3335b16ff240-delete_snapshot" released by "delete_snapshot" :: held 6.535s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Snapshots deleted, issuing volume delete {{(pid=87011) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 14:16:42 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "cinder-quobyte-e140cf65-31b7-4432-b187-3dd5a9841e7c" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:42 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-e140cf65-31b7-4432-b187-3dd5a9841e7c" acquired by "delete_volume" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:42 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a80911-0513-4831-8712-b260cd48b965]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:42 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c Jul 09 14:16:42 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:43 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c" returned: 0 in 1.067s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:43 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c Jul 09 14:16:43 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:43 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e140cf65-31b7-4432-b187-3dd5a9841e7c" returned: 0 in 0.702s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-e140cf65-31b7-4432-b187-3dd5a9841e7c" released by "delete_volume" :: held 1.858s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Created reservations ['106a0e7d-bfa8-4fc5-9391-875f17344fb0', 'bf22003e-802e-4e4c-86da-27b6284c189a', '386816a2-1955-4bbe-8b14-70531c4418fc', 'dcf124e9-8caf-489f-a788-c45fcaf4507c'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:44 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:16:44 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Flow 'volume_create_manager' (322cd002-2914-4347-9249-62356880d8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5675752f-d612-437d-805b-fcfbc45516af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5675752f-d612-437d-805b-fcfbc45516af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-34848980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d742488-a85c-4bd5-9def-272478df2d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c2dadd07eb24ea990e4779c0642691c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:44Z,use_quota=True,user_id='dd7de28939904af2913705249c3bc56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8fc5f4-96c7-4c6b-950f-ad9485d1005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8fc5f4-96c7-4c6b-950f-ad9485d1005a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc7f13c-3cc1-4b90-8a27-087423cac642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc7f13c-3cc1-4b90-8a27-087423cac642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d742488-a85c-4bd5-9def-272478df2d4f', 'volume_name': 'volume-4d742488-a85c-4bd5-9def-272478df2d4f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e7a684-9e68-4cf6-aa7a-f2a34ed5135a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e7a684-9e68-4cf6-aa7a-f2a34ed5135a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34cdda12-8c99-4559-8d6a-2be15c4d20c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:44 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Volume 4d742488-a85c-4bd5-9def-272478df2d4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d742488-a85c-4bd5-9def-272478df2d4f', 'volume_size': 1} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-34848980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d742488-a85c-4bd5-9def-272478df2d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c2dadd07eb24ea990e4779c0642691c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:44Z,use_quota=True,user_id='dd7de28939904af2913705249c3bc56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Creating volume 4d742488-a85c-4bd5-9def-272478df2d4f {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:16:44 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:44 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f 1073741824 Jul 09 14:16:44 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:44 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.714s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:16:44 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Deleted volume successfully. Jul 09 14:16:44 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1de3dd2-19fe-449e-8b69-b9ec5d535519 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-e140cf65-31b7-4432-b187-3dd5a9841e7c-delete_volume" released by "delete_volume" :: held 20.221s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:16:45 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f 1073741824" returned: 0 in 1.008s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:45 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f Jul 09 14:16:45 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:45 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:16:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Flow 'volume_create_manager' (9551cf49-4851-4e2e-a31b-78ded20c851c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a2bb56-49b6-42d0-9875-ef5ab1b8796d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a2bb56-49b6-42d0-9875-ef5ab1b8796d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-330834627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4049f710-5ad9-47fd-b40e-7899fb6253c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49ab6bd0fb34c478b305c1deea0446b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:46Z,use_quota=True,user_id='67692433143c47f8b67c50b392466031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5eb84e-38d7-45a6-8dd2-ca6ec3933dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5eb84e-38d7-45a6-8dd2-ca6ec3933dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057b9652-f3a3-40c5-8890-ad0c89471757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057b9652-f3a3-40c5-8890-ad0c89471757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4049f710-5ad9-47fd-b40e-7899fb6253c3', 'volume_name': 'volume-4049f710-5ad9-47fd-b40e-7899fb6253c3', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddba2bfe-a240-44ba-86ac-f936248f3342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddba2bfe-a240-44ba-86ac-f936248f3342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f84929-6376-421a-9af7-ccd1fdb1c77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:45 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Volume 4049f710-5ad9-47fd-b40e-7899fb6253c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4049f710-5ad9-47fd-b40e-7899fb6253c3', 'volume_size': 1} Jul 09 14:16:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:46 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f" returned: 0 in 0.687s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:16:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.535s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-330834627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4049f710-5ad9-47fd-b40e-7899fb6253c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49ab6bd0fb34c478b305c1deea0446b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:46Z,use_quota=True,user_id='67692433143c47f8b67c50b392466031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:16:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Creating volume 4049f710-5ad9-47fd-b40e-7899fb6253c3 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:16:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:16:46 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:16:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34cdda12-8c99-4559-8d6a-2be15c4d20c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d742488-a85c-4bd5-9def-272478df2d4f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0892b32-59be-42ca-9a19-8c8e1d1284c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:46 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 1073741824 Jul 09 14:16:46 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:46 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Volume volume-4d742488-a85c-4bd5-9def-272478df2d4f (4d742488-a85c-4bd5-9def-272478df2d4f): created successfully Jul 09 14:16:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0892b32-59be-42ca-9a19-8c8e1d1284c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Flow 'volume_create_manager' (322cd002-2914-4347-9249-62356880d8ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:46 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-925a4279-53e0-45f6-99f7-59b043ec71ec tempest-VolumesActionsTest-558150910 None] Created volume successfully. Jul 09 14:16:47 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 1073741824" returned: 0 in 0.929s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:47 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 Jul 09 14:16:47 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:48 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3" returned: 0 in 0.828s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:16:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f84929-6376-421a-9af7-ccd1fdb1c77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4049f710-5ad9-47fd-b40e-7899fb6253c3', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ef783e-b1b9-4518-ac9d-023ff97831b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:48 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Volume volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 (4049f710-5ad9-47fd-b40e-7899fb6253c3): created successfully Jul 09 14:16:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ef783e-b1b9-4518-ac9d-023ff97831b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Flow 'volume_create_manager' (9551cf49-4851-4e2e-a31b-78ded20c851c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:48 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-1567af7b-c9ba-4807-8a27-4beb2feaa6cb tempest-VolumesDeleteCascade-1326290886 None] Created volume successfully. Jul 09 14:16:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:49 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] Creating offline snapshot 6d9f2651-d16e-4a43-addc-1d93d1585a7b of volume 4049f710-5ad9-47fd-b40e-7899fb6253c3 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:16:49 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4486181-cad1-48e4-aa75-907805f1500a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:49 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 Jul 09 14:16:49 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:49 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:16:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Flow 'volume_create_manager' (42211786-1277-4983-9263-45c01d07f750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36672c75-25d4-4a1a-bd51-572d675bd943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36672c75-25d4-4a1a-bd51-572d675bd943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1570974975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffdc32dc-0b41-4bd9-bde4-4038384a7b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42fb441164804d6d98df8a4b22fe4398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:50Z,use_quota=True,user_id='0b239b9ab50f4bd098212a0a65b5426c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713f59aa-20b2-4ee9-9ec4-0da7200f4d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713f59aa-20b2-4ee9-9ec4-0da7200f4d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d43c25b-6e8d-45f2-82b9-a8d0d2f31116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d43c25b-6e8d-45f2-82b9-a8d0d2f31116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffdc32dc-0b41-4bd9-bde4-4038384a7b30', 'volume_name': 'volume-ffdc32dc-0b41-4bd9-bde4-4038384a7b30', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b2b276-cd3f-41b8-b1ff-efa04ef3540e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b2b276-cd3f-41b8-b1ff-efa04ef3540e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5e3d0c-c8b9-4420-b35f-92f3eecceea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:49 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Volume ffdc32dc-0b41-4bd9-bde4-4038384a7b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffdc32dc-0b41-4bd9-bde4-4038384a7b30', 'volume_size': 1} Jul 09 14:16:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:50 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3" returned: 0 in 0.881s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:50 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b 1G Jul 09 14:16:50 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:50 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b 1G" returned: 0 in 0.807s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:50 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b Jul 09 14:16:50 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:51 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b" returned: 0 in 0.704s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:51 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b is being set with open permissions: ugo+rw Jul 09 14:16:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:51 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b Jul 09 14:16:51 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:52 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b" returned: 0 in 0.639s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:52 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.info Jul 09 14:16:52 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:52 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.info" returned: 0 in 0.678s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:52 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.info is being set with open permissions: ugo+rw Jul 09 14:16:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:52 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.info Jul 09 14:16:52 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:53 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.info" returned: 0 in 0.769s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.572s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.945s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1570974975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffdc32dc-0b41-4bd9-bde4-4038384a7b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42fb441164804d6d98df8a4b22fe4398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:50Z,use_quota=True,user_id='0b239b9ab50f4bd098212a0a65b5426c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:16:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Creating volume ffdc32dc-0b41-4bd9-bde4-4038384a7b30 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:16:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:16:53 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:16:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ffdc32dc-0b41-4bd9-bde4-4038384a7b30 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:53 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ffdc32dc-0b41-4bd9-bde4-4038384a7b30 1073741824 Jul 09 14:16:53 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:53 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-62a486da-c966-412c-aafc-9e85daf8ae68 tempest-VolumesDeleteCascade-1326290886 None] Create snapshot completed successfully Jul 09 14:16:54 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ffdc32dc-0b41-4bd9-bde4-4038384a7b30 1073741824" returned: 0 in 1.233s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ffdc32dc-0b41-4bd9-bde4-4038384a7b30 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:55 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ffdc32dc-0b41-4bd9-bde4-4038384a7b30 Jul 09 14:16:55 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Flow 'volume_create_manager' (78c86de4-7375-4c20-a009-fc8dd07a6e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c965e9d7-7b36-4052-9d0c-d12907285ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c965e9d7-7b36-4052-9d0c-d12907285ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1457449359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48daed8-4dbf-4dfa-8d14-05ee4999c2c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7de023e075a4cbfa155ec1f9e6ee967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:55Z,use_quota=True,user_id='9543c74ad968468b85af39b9df39b3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e70155-7e96-4f5f-a9b6-c7cb5461d0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e70155-7e96-4f5f-a9b6-c7cb5461d0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b903de-23f8-4f0b-a421-74cb953ddf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b903de-23f8-4f0b-a421-74cb953ddf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c48daed8-4dbf-4dfa-8d14-05ee4999c2c8', 'volume_name': 'volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27edfcad-417d-4997-a515-a8f90575fbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27edfcad-417d-4997-a515-a8f90575fbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de90e18f-94b2-498f-b0f6-af16f580ca7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:55 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Volume c48daed8-4dbf-4dfa-8d14-05ee4999c2c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8', 'volume_size': 1} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Flow 'volume_create_manager' (bfa6bc2c-31da-4f77-916a-9230eec417c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (272518c8-02e9-4454-be0a-dd362eccb63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (272518c8-02e9-4454-be0a-dd362eccb63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1136271773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f08b351b-f265-4ae8-afc6-9509abb8c0ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49ab6bd0fb34c478b305c1deea0446b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6d9f2651-d16e-4a43-addc-1d93d1585a7b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:55Z,use_quota=True,user_id='67692433143c47f8b67c50b392466031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f43de09-0fe7-4229-9c36-5136bfc0064c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f43de09-0fe7-4229-9c36-5136bfc0064c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d56101f0-11c7-48e3-ae89-3eebe6ecb025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d56101f0-11c7-48e3-ae89-3eebe6ecb025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f08b351b-f265-4ae8-afc6-9509abb8c0ba', 'volume_name': 'volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba', 'volume_size': 1, 'snapshot_id': '6d9f2651-d16e-4a43-addc-1d93d1585a7b'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983cf454-4607-45ce-8650-7e196f92267c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983cf454-4607-45ce-8650-7e196f92267c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd52f7e7-720f-4b29-9fec-70c5252331f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:55 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Volume f08b351b-f265-4ae8-afc6-9509abb8c0ba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba', 'volume_size': 1, 'snapshot_id': '6d9f2651-d16e-4a43-addc-1d93d1585a7b'} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:55 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ffdc32dc-0b41-4bd9-bde4-4038384a7b30" returned: 0 in 0.752s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.255s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1457449359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c48daed8-4dbf-4dfa-8d14-05ee4999c2c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7de023e075a4cbfa155ec1f9e6ee967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:16:55Z,use_quota=True,user_id='9543c74ad968468b85af39b9df39b3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Creating volume c48daed8-4dbf-4dfa-8d14-05ee4999c2c8 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:16:55 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:55 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8 1073741824 Jul 09 14:16:55 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c5e3d0c-c8b9-4420-b35f-92f3eecceea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffdc32dc-0b41-4bd9-bde4-4038384a7b30', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5f41e7-2e2a-4f63-9264-9334d5c75e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:55 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Volume volume-ffdc32dc-0b41-4bd9-bde4-4038384a7b30 (ffdc32dc-0b41-4bd9-bde4-4038384a7b30): created successfully Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5f41e7-2e2a-4f63-9264-9334d5c75e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Flow 'volume_create_manager' (42211786-1277-4983-9263-45c01d07f750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:55 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9b5c9237-8e87-4087-9f99-de3b9851ad78 tempest-VolumesTransfersV355Test-2030463988 None] Created volume successfully. Jul 09 14:16:56 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8 1073741824" returned: 0 in 0.877s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:56 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8 Jul 09 14:16:56 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:56 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ab781488-09a8-4d10-8f8b-98d54bc4ecfc tempest-VolumesTransfersV355Test-221336231 None] Transfer volume completed successfully. Jul 09 14:16:57 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8" returned: 0 in 0.660s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.708s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "cinder-quobyte-6d9f2651-d16e-4a43-addc-1d93d1585a7b-f08b351b-f265-4ae8-afc6-9509abb8c0ba" by "_create_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de90e18f-94b2-498f-b0f6-af16f580ca7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a49bb0-8ac6-4dfc-8e46-0cf7d685b756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-6d9f2651-d16e-4a43-addc-1d93d1585a7b-f08b351b-f265-4ae8-afc6-9509abb8c0ba" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Creating volume f08b351b-f265-4ae8-afc6-9509abb8c0ba from snapshot 6d9f2651-d16e-4a43-addc-1d93d1585a7b {{(pid=87011) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "cinder-quobyte-f08b351b-f265-4ae8-afc6-9509abb8c0ba" by "_copy_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:57 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Volume volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8 (c48daed8-4dbf-4dfa-8d14-05ee4999c2c8): created successfully Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a49bb0-8ac6-4dfc-8e46-0cf7d685b756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Flow 'volume_create_manager' (78c86de4-7375-4c20-a009-fc8dd07a6e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:16:57 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-0bf9a964-f4da-4583-b0f0-95c7b0108182 tempest-AttachVolumeTestJSON-1739532221 None] Created volume successfully. Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-f08b351b-f265-4ae8-afc6-9509abb8c0ba" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] snapshot: 6d9f2651-d16e-4a43-addc-1d93d1585a7b, volume: f08b351b-f265-4ae8-afc6-9509abb8c0ba, {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c7fee3-44eb-42ff-9212-5cab0555447a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:57 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b Jul 09 14:16:57 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] Acquiring lock "cinder-ffdc32dc-0b41-4bd9-bde4-4038384a7b30-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] Lock "cinder-ffdc32dc-0b41-4bd9-bde4-4038384a7b30-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] Acquiring lock "cinder-quobyte-ffdc32dc-0b41-4bd9-bde4-4038384a7b30" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] Lock "cinder-quobyte-ffdc32dc-0b41-4bd9-bde4-4038384a7b30" acquired by "delete_volume" :: waited 0.014s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99860cd-eebe-4b34-8a5a-de4e2bb0482d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ffdc32dc-0b41-4bd9-bde4-4038384a7b30 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:58 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ffdc32dc-0b41-4bd9-bde4-4038384a7b30 Jul 09 14:16:58 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:58 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b" returned: 0 in 1.112s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4049f710-5ad9-47fd-b40e-7899fb6253c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:16:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 14:16:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Creating direct copy from snapshot {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 14:16:58 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[7375f958-b2f0-4d61-810f-4fac31c29bfa]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:16:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:58 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 Jul 09 14:16:58 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:59 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ffdc32dc-0b41-4bd9-bde4-4038384a7b30" returned: 0 in 1.233s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ffdc32dc-0b41-4bd9-bde4-4038384a7b30 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:59 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ffdc32dc-0b41-4bd9-bde4-4038384a7b30 Jul 09 14:16:59 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:59 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3" returned: 0 in 0.957s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:59 devstack cinder-volume[87011]: DEBUG cinder.utils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Path /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba not found in is_blk_device check {{(pid=87011) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 14:16:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:16:59 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba Jul 09 14:16:59 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:16:59 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Jul 09 14:16:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ffdc32dc-0b41-4bd9-bde4-4038384a7b30" returned: 0 in 0.795s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:16:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] Lock "cinder-quobyte-ffdc32dc-0b41-4bd9-bde4-4038384a7b30" released by "delete_volume" :: held 2.074s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:00 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] Created reservations ['65a5642a-61d4-4bbd-bd81-e48ef4c3bfa3', 'c5e5e0d6-b243-42c3-8901-13fef227ac40', 'a8a95b4a-abbb-416e-b66a-bab7a4cc65a5', 'b4ec68cb-8529-48ff-94f8-eee8f62caba1'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:17:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:00 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:17:00 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:01 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:17:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Flow 'volume_create_manager' (3e5d0418-6868-4b10-91f4-53ac8b66cc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:17:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f9fcf6-c93c-46de-adee-20e4ecf1e9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f9fcf6-c93c-46de-adee-20e4ecf1e9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1604690190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27af8e6d-e8cb-4a38-b768-0d56f909f54f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42fb441164804d6d98df8a4b22fe4398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:17:01Z,use_quota=True,user_id='0b239b9ab50f4bd098212a0a65b5426c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210450c3-6e65-4c3b-b624-0285a84afc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210450c3-6e65-4c3b-b624-0285a84afc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b3da9c-3f48-4ea3-a889-4ce34eed3256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b3da9c-3f48-4ea3-a889-4ce34eed3256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27af8e6d-e8cb-4a38-b768-0d56f909f54f', 'volume_name': 'volume-27af8e6d-e8cb-4a38-b768-0d56f909f54f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4cc203-8400-4b54-9406-fa3377ec653f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4cc203-8400-4b54-9406-fa3377ec653f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70edf7b7-6554-4b59-8573-65d7054ded1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:01 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Volume 27af8e6d-e8cb-4a38-b768-0d56f909f54f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27af8e6d-e8cb-4a38-b768-0d56f909f54f', 'volume_size': 1} Jul 09 14:17:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:02 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.965s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:02 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:17:02 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] Deleted volume successfully. Jul 09 14:17:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b640e3b6-eecd-47f7-bf77-392b728ff10c tempest-VolumesTransfersV355Test-1457108600 None] Lock "cinder-ffdc32dc-0b41-4bd9-bde4-4038384a7b30-delete_volume" released by "delete_volume" :: held 4.336s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-2f7e8662-6a53-4d45-a4a3-6d643dee7adc req-3284719f-f64c-45d6-979f-6b3a13d46662 tempest-AttachVolumeTestJSON-1739532221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-399b85b0-115f-4aeb-ac25-cefde0c8d93e tempest-VolumesActionsTest-558150910 None] Acquiring lock "cinder-4d742488-a85c-4bd5-9def-272478df2d4f" by "attach_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-399b85b0-115f-4aeb-ac25-cefde0c8d93e tempest-VolumesActionsTest-558150910 None] Lock "cinder-4d742488-a85c-4bd5-9def-272478df2d4f" acquired by "attach_volume" :: waited 0.041s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:04 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-399b85b0-115f-4aeb-ac25-cefde0c8d93e tempest-VolumesActionsTest-558150910 None] Attaching volume 4d742488-a85c-4bd5-9def-272478df2d4f to instance 44f96129-0235-4d1b-8099-7ee582d25083 at mountpoint /dev/vdb on host None. Jul 09 14:17:04 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-399b85b0-115f-4aeb-ac25-cefde0c8d93e tempest-VolumesActionsTest-558150910 None] Attach volume completed successfully. Jul 09 14:17:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-399b85b0-115f-4aeb-ac25-cefde0c8d93e tempest-VolumesActionsTest-558150910 None] Lock "cinder-4d742488-a85c-4bd5-9def-272478df2d4f" released by "attach_volume" :: held 0.251s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:05 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-66372443-26ec-476e-bcea-c06c17881196 tempest-VolumesActionsTest-558150910 None] Acquiring lock "cinder-4d742488-a85c-4bd5-9def-272478df2d4f-detach_volume" by "detach_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:05 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-66372443-26ec-476e-bcea-c06c17881196 tempest-VolumesActionsTest-558150910 None] Lock "cinder-4d742488-a85c-4bd5-9def-272478df2d4f-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:05 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-66372443-26ec-476e-bcea-c06c17881196 tempest-VolumesActionsTest-558150910 None] Detaching volume 4d742488-a85c-4bd5-9def-272478df2d4f from instance 44f96129-0235-4d1b-8099-7ee582d25083. Jul 09 14:17:05 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-66372443-26ec-476e-bcea-c06c17881196 tempest-VolumesActionsTest-558150910 None] Detach volume completed successfully. Jul 09 14:17:05 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-66372443-26ec-476e-bcea-c06c17881196 tempest-VolumesActionsTest-558150910 None] Lock "cinder-4d742488-a85c-4bd5-9def-272478df2d4f-detach_volume" released by "detach_volume" :: held 0.077s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:05 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba" returned: 0 in 6.349s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:05 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa032e2-0791-47a8-aa9c-866a9ad757c8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:06 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 Jul 09 14:17:06 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:06 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3" returned: 0 in 0.940s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:06 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:17:06 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Converted 1024.00 MB image at 161.26 MB/s Jul 09 14:17:06 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba is being set with open permissions: ugo+rw Jul 09 14:17:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:06 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba Jul 09 14:17:06 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:07 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba" returned: 0 in 0.649s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-f08b351b-f265-4ae8-afc6-9509abb8c0ba" released by "_copy_volume_from_snapshot" :: held 10.136s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-6d9f2651-d16e-4a43-addc-1d93d1585a7b-f08b351b-f265-4ae8-afc6-9509abb8c0ba" released by "_create_volume_from_snapshot" :: held 10.199s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.235s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.078s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1604690190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27af8e6d-e8cb-4a38-b768-0d56f909f54f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42fb441164804d6d98df8a4b22fe4398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:17:01Z,use_quota=True,user_id='0b239b9ab50f4bd098212a0a65b5426c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:17:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Creating volume 27af8e6d-e8cb-4a38-b768-0d56f909f54f {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:17:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:17:07 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:17:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-27af8e6d-e8cb-4a38-b768-0d56f909f54f 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:07 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-27af8e6d-e8cb-4a38-b768-0d56f909f54f 1073741824 Jul 09 14:17:07 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd52f7e7-720f-4b29-9fec-70c5252331f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba', 'volume_size': 1, 'snapshot_id': '6d9f2651-d16e-4a43-addc-1d93d1585a7b'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30870ec1-20c5-4663-86b0-2e0af25f626c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:07 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Volume volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba (f08b351b-f265-4ae8-afc6-9509abb8c0ba): created successfully Jul 09 14:17:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30870ec1-20c5-4663-86b0-2e0af25f626c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Flow 'volume_create_manager' (bfa6bc2c-31da-4f77-916a-9230eec417c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:17:07 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c4f9adaf-5483-4239-953f-57695a160e31 tempest-VolumesDeleteCascade-1326290886 None] Created volume successfully. Jul 09 14:17:08 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-27af8e6d-e8cb-4a38-b768-0d56f909f54f 1073741824" returned: 0 in 0.940s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-27af8e6d-e8cb-4a38-b768-0d56f909f54f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:08 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-27af8e6d-e8cb-4a38-b768-0d56f909f54f Jul 09 14:17:08 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:08 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "cinder-4049f710-5ad9-47fd-b40e-7899fb6253c3-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:08 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-4049f710-5ad9-47fd-b40e-7899fb6253c3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Performing cascade delete. {{(pid=87011) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "cinder-6d9f2651-d16e-4a43-addc-1d93d1585a7b-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-6d9f2651-d16e-4a43-addc-1d93d1585a7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "cinder-quobyte-4049f710-5ad9-47fd-b40e-7899fb6253c3" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-4049f710-5ad9-47fd-b40e-7899fb6253c3" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "cinder-quobyte-6d9f2651-d16e-4a43-addc-1d93d1585a7b" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-6d9f2651-d16e-4a43-addc-1d93d1585a7b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Deleting offline snapshot 6d9f2651-d16e-4a43-addc-1d93d1585a7b of volume 4049f710-5ad9-47fd-b40e-7899fb6253c3 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] snapshot_file for this snap is: volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3a27d8-9c85-4037-a5c6-d5978a807df9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:09 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-27af8e6d-e8cb-4a38-b768-0d56f909f54f" returned: 0 in 0.702s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-2f7e8662-6a53-4d45-a4a3-6d643dee7adc req-3284719f-f64c-45d6-979f-6b3a13d46662 tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.380s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70edf7b7-6554-4b59-8573-65d7054ded1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27af8e6d-e8cb-4a38-b768-0d56f909f54f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd202f58-06af-4b94-bfdc-edf603185588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fcdfd1-2cfa-4ed9-954a-69ee09f23c18]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-2f7e8662-6a53-4d45-a4a3-6d643dee7adc req-3284719f-f64c-45d6-979f-6b3a13d46662 tempest-AttachVolumeTestJSON-1739532221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:09 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b Jul 09 14:17:09 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:09 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Volume volume-27af8e6d-e8cb-4a38-b768-0d56f909f54f (27af8e6d-e8cb-4a38-b768-0d56f909f54f): created successfully Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd202f58-06af-4b94-bfdc-edf603185588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Flow 'volume_create_manager' (3e5d0418-6868-4b10-91f4-53ac8b66cc2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:17:09 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-8b822985-03d9-427e-b767-27b41dda00ab tempest-VolumesTransfersV355Test-2030463988 None] Created volume successfully. Jul 09 14:17:09 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8 Jul 09 14:17:09 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:10 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b" returned: 0 in 0.890s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4049f710-5ad9-47fd-b40e-7899fb6253c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:17:10 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc477189-85d6-461a-86c6-45f3ebe071b7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:10 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-2f7e8662-6a53-4d45-a4a3-6d643dee7adc req-3284719f-f64c-45d6-979f-6b3a13d46662 tempest-AttachVolumeTestJSON-1739532221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8" returned: 0 in 0.888s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-2f7e8662-6a53-4d45-a4a3-6d643dee7adc req-3284719f-f64c-45d6-979f-6b3a13d46662 tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.915s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:10 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 Jul 09 14:17:10 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-2f7e8662-6a53-4d45-a4a3-6d643dee7adc req-3284719f-f64c-45d6-979f-6b3a13d46662 tempest-AttachVolumeTestJSON-1739532221 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24596e87-7241-4067-a00b-8aec576687ed', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:17:10 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-2f7e8662-6a53-4d45-a4a3-6d643dee7adc req-3284719f-f64c-45d6-979f-6b3a13d46662 tempest-AttachVolumeTestJSON-1739532221 None] attachment_update completed successfully. Jul 09 14:17:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] Acquiring lock "cinder-27af8e6d-e8cb-4a38-b768-0d56f909f54f-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] Lock "cinder-27af8e6d-e8cb-4a38-b768-0d56f909f54f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] Acquiring lock "cinder-quobyte-27af8e6d-e8cb-4a38-b768-0d56f909f54f" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] Lock "cinder-quobyte-27af8e6d-e8cb-4a38-b768-0d56f909f54f" acquired by "delete_volume" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:10 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff927c3e-511f-4b82-aa92-e60334fa9ed2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-27af8e6d-e8cb-4a38-b768-0d56f909f54f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:10 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-27af8e6d-e8cb-4a38-b768-0d56f909f54f Jul 09 14:17:10 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:10 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3" returned: 0 in 0.861s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:10 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b Jul 09 14:17:10 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:11 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-27af8e6d-e8cb-4a38-b768-0d56f909f54f" returned: 0 in 0.869s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-27af8e6d-e8cb-4a38-b768-0d56f909f54f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:11 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-27af8e6d-e8cb-4a38-b768-0d56f909f54f Jul 09 14:17:11 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:11 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b" returned: 0 in 0.887s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:11 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b Jul 09 14:17:11 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:12 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-27af8e6d-e8cb-4a38-b768-0d56f909f54f" returned: 0 in 0.693s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] Lock "cinder-quobyte-27af8e6d-e8cb-4a38-b768-0d56f909f54f" released by "delete_volume" :: held 1.607s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] Created reservations ['41b720ec-2952-4d8c-9fd2-3f8f9cb56314', '129551a4-8f54-4764-b8c7-9f61a943718d', 'c31cc72a-b0d1-4e9b-a16d-356282fc5ea2', '9c73ba80-23e9-4bc5-854c-6a9d65ac07fe'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:12 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:17:12 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:12 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3.6d9f2651-d16e-4a43-addc-1d93d1585a7b" returned: 0 in 0.644s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-6d9f2651-d16e-4a43-addc-1d93d1585a7b" released by "_delete_snapshot" :: held 3.423s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-4049f710-5ad9-47fd-b40e-7899fb6253c3" released by "delete_snapshot" :: held 3.460s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:12 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:17:12 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Created reservations ['e716050d-b151-44fe-8b6e-91323096409c', '36a862a4-59cf-4b83-9812-27209a0c0e42', '998f4b2f-24ef-46ed-b69a-3b0e08a19307', '69755c31-1362-474a-b749-c31fb6dc3518'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:17:12 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Delete snapshot completed successfully. Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-6d9f2651-d16e-4a43-addc-1d93d1585a7b-delete_snapshot" released by "delete_snapshot" :: held 3.655s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Snapshots deleted, issuing volume delete {{(pid=87011) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "cinder-quobyte-4049f710-5ad9-47fd-b40e-7899fb6253c3" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-4049f710-5ad9-47fd-b40e-7899fb6253c3" acquired by "delete_volume" :: waited 0.026s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7faf326-3bc0-440e-b8ea-df8c394041d8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:12 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.754s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:17:12 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] Deleted volume successfully. Jul 09 14:17:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3057ffff-9431-4746-985b-d739a77aaa29 tempest-VolumesTransfersV355Test-1457108600 None] Lock "cinder-27af8e6d-e8cb-4a38-b768-0d56f909f54f-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:12 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 Jul 09 14:17:12 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:13 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.792s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:17:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:17:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:17:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:17:13 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3" returned: 0 in 0.898s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:13 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3 Jul 09 14:17:13 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:14 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4049f710-5ad9-47fd-b40e-7899fb6253c3" returned: 0 in 0.732s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-4049f710-5ad9-47fd-b40e-7899fb6253c3" released by "delete_volume" :: held 1.737s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:14 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Created reservations ['0376f38f-9543-4b0a-87b1-bdfad4ae5593', '1375ce3a-a430-4239-9db9-7a5b2de6e6a2', 'fcb53338-8f7d-4499-9a7a-27fc295bb4a6', 'ab835f09-8d8e-4df5-8a73-9365baa10901'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:17:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:14 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:17:14 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:15 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.809s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:15 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:17:15 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Deleted volume successfully. Jul 09 14:17:15 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-29ca6cdc-6259-4bba-96e8-403ef119341b tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-4049f710-5ad9-47fd-b40e-7899fb6253c3-delete_volume" released by "delete_volume" :: held 6.501s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:15 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "cinder-f08b351b-f265-4ae8-afc6-9509abb8c0ba-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:15 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-f08b351b-f265-4ae8-afc6-9509abb8c0ba-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:15 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "cinder-quobyte-f08b351b-f265-4ae8-afc6-9509abb8c0ba" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:15 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-f08b351b-f265-4ae8-afc6-9509abb8c0ba" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:15 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca858a1e-0f23-45bf-a177-239c215ecf8f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:15 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba Jul 09 14:17:15 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Flow 'volume_create_manager' (6f41f649-61d8-4660-ad76-13fa6ea4b7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5b2b13-da6e-4cf3-acdf-f868faf24f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5b2b13-da6e-4cf3-acdf-f868faf24f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1587154436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f167aac2-472c-4a49-9d0f-4e156b3b2c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7de023e075a4cbfa155ec1f9e6ee967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:17:16Z,use_quota=True,user_id='9543c74ad968468b85af39b9df39b3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1d2c0e-4931-46a4-b3f0-5d394d801a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1d2c0e-4931-46a4-b3f0-5d394d801a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f818538e-53bc-4212-99fa-96763976b6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f818538e-53bc-4212-99fa-96763976b6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f167aac2-472c-4a49-9d0f-4e156b3b2c6e', 'volume_name': 'volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d60cedac-78e5-495e-9206-8081180be25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d60cedac-78e5-495e-9206-8081180be25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec9c3cb-8c64-4b01-b09b-b44b79450e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:16 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Volume f167aac2-472c-4a49-9d0f-4e156b3b2c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e', 'volume_size': 1} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1587154436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f167aac2-472c-4a49-9d0f-4e156b3b2c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7de023e075a4cbfa155ec1f9e6ee967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:17:16Z,use_quota=True,user_id='9543c74ad968468b85af39b9df39b3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Creating volume f167aac2-472c-4a49-9d0f-4e156b3b2c6e {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:17:16 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:16 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e 1073741824 Jul 09 14:17:16 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:16 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba" returned: 0 in 0.908s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:16 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba Jul 09 14:17:16 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:17 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e 1073741824" returned: 0 in 0.984s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:17 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e Jul 09 14:17:17 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:17 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f08b351b-f265-4ae8-afc6-9509abb8c0ba" returned: 0 in 0.762s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-quobyte-f08b351b-f265-4ae8-afc6-9509abb8c0ba" released by "delete_volume" :: held 1.729s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:17 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] Created reservations ['e576f7a9-c235-4ce3-9f94-cfecc1474a06', '05ba6a63-579c-4ea8-b063-f17c0dd12cb7', 'b0676b97-9733-4313-9784-ae8b119b19a8', '06a97f9b-de3d-468e-94f1-347ec88be2cc'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:17:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:17 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:17:17 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:18 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e" returned: 0 in 0.757s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:17:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:18 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec9c3cb-8c64-4b01-b09b-b44b79450e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:18 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5600cb-048f-46b5-8c03-f1a1ebe71988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:18 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Volume volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e (f167aac2-472c-4a49-9d0f-4e156b3b2c6e): created successfully Jul 09 14:17:18 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5600cb-048f-46b5-8c03-f1a1ebe71988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:18 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Flow 'volume_create_manager' (6f41f649-61d8-4660-ad76-13fa6ea4b7b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:17:18 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a3622ad2-a17b-449d-84e6-6d84499116ff tempest-AttachVolumeTestJSON-1739532221 None] Created volume successfully. Jul 09 14:17:18 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.748s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:18 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:17:18 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] Deleted volume successfully. Jul 09 14:17:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-68ffc182-931a-4e2f-b10e-83319d3c7407 tempest-VolumesDeleteCascade-1326290886 None] Lock "cinder-f08b351b-f265-4ae8-afc6-9509abb8c0ba-delete_volume" released by "delete_volume" :: held 2.749s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Flow 'volume_create_manager' (09fb5803-122a-41d0-ac17-c883760329a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912ac3b5-6375-46f1-86d0-847d21bae382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (912ac3b5-6375-46f1-86d0-847d21bae382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-117689731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a124ade-cc46-4d03-ae1a-98a2dc717d5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='73f054e423164c90940b767c8e1eee63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:17:19Z,use_quota=True,user_id='ecf030c34bb840d0bb697f437ad4f560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d5f016-b257-43e9-8599-b9305361c4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7d5f016-b257-43e9-8599-b9305361c4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80371fa-f0f9-4400-a163-98eaf561a987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80371fa-f0f9-4400-a163-98eaf561a987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a124ade-cc46-4d03-ae1a-98a2dc717d5e', 'volume_name': 'volume-0a124ade-cc46-4d03-ae1a-98a2dc717d5e', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdd6b80-ab88-401d-b3c8-36d72b7b499e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbdd6b80-ab88-401d-b3c8-36d72b7b499e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f03a68c6-5b76-42d8-80f7-9f18d31d6216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:19 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Volume 0a124ade-cc46-4d03-ae1a-98a2dc717d5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a124ade-cc46-4d03-ae1a-98a2dc717d5e', 'volume_size': 1} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-117689731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a124ade-cc46-4d03-ae1a-98a2dc717d5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='73f054e423164c90940b767c8e1eee63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:17:19Z,use_quota=True,user_id='ecf030c34bb840d0bb697f437ad4f560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Creating volume 0a124ade-cc46-4d03-ae1a-98a2dc717d5e {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:17:19 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:17:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a124ade-cc46-4d03-ae1a-98a2dc717d5e 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:19 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a124ade-cc46-4d03-ae1a-98a2dc717d5e 1073741824 Jul 09 14:17:19 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:20 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a124ade-cc46-4d03-ae1a-98a2dc717d5e 1073741824" returned: 0 in 1.041s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a124ade-cc46-4d03-ae1a-98a2dc717d5e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:20 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a124ade-cc46-4d03-ae1a-98a2dc717d5e Jul 09 14:17:20 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:21 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a124ade-cc46-4d03-ae1a-98a2dc717d5e" returned: 0 in 0.844s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f03a68c6-5b76-42d8-80f7-9f18d31d6216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a124ade-cc46-4d03-ae1a-98a2dc717d5e', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef281862-6b2f-4961-a1d0-ca88073d676a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:21 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Volume volume-0a124ade-cc46-4d03-ae1a-98a2dc717d5e (0a124ade-cc46-4d03-ae1a-98a2dc717d5e): created successfully Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef281862-6b2f-4961-a1d0-ca88073d676a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Flow 'volume_create_manager' (09fb5803-122a-41d0-ac17-c883760329a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:17:21 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-dd2da0be-40cc-4226-a001-1101838e1b05 tempest-VolumesListTestJSON-757628808 None] Created volume successfully. Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Flow 'volume_create_manager' (cf64fbf4-e6f1-49d3-b6b8-f8fc884299ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82cd9e8-bb1c-4e58-9288-934cad3b2157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82cd9e8-bb1c-4e58-9288-934cad3b2157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2078819225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed7605df3674181ab0925ea14c7995b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:17:22Z,use_quota=True,user_id='134ce26f58a3429889cf104fba46f8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff38a98e-c65d-4e54-b338-e290a5891af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff38a98e-c65d-4e54-b338-e290a5891af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9269f50d-30e2-4608-9402-56bf94324991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9269f50d-30e2-4608-9402-56bf94324991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3', 'volume_name': 'volume-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97cffd7e-ed79-4a94-b3b7-9b716f4c6aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97cffd7e-ed79-4a94-b3b7-9b716f4c6aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b6e895-c259-45bc-b575-66e1d47f6ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:21 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Volume 1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3', 'volume_size': 1} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2078819225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ed7605df3674181ab0925ea14c7995b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:17:22Z,use_quota=True,user_id='134ce26f58a3429889cf104fba46f8b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Creating volume 1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:17:21 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:17:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:21 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3 1073741824 Jul 09 14:17:21 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-eabbedb8-5d68-4ca7-bfc5-e584dfeef161 req-d0f686ac-28d1-481f-8111-d003e81a118f tempest-AttachVolumeTestJSON-1739532221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:22 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3 1073741824" returned: 0 in 0.970s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:22 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3 Jul 09 14:17:22 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Flow 'volume_create_manager' (ea8bf776-63dd-47e5-8635-99b069c107e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7458feb5-ea4f-4143-9171-d3927f61e9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7458feb5-ea4f-4143-9171-d3927f61e9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1665053026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13696b1-fbeb-47a9-9749-956aa9363064,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='73f054e423164c90940b767c8e1eee63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:17:23Z,use_quota=True,user_id='ecf030c34bb840d0bb697f437ad4f560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4e3513-35ea-4abf-a4f6-6a867cfdb291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4e3513-35ea-4abf-a4f6-6a867cfdb291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (552aefbf-2f4a-436c-a855-94e3e19bb33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (552aefbf-2f4a-436c-a855-94e3e19bb33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f13696b1-fbeb-47a9-9749-956aa9363064', 'volume_name': 'volume-f13696b1-fbeb-47a9-9749-956aa9363064', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c1349e-d092-47b2-ab19-2e5364f0f84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c1349e-d092-47b2-ab19-2e5364f0f84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a30f5d-f84d-444b-9453-9fa5a8099010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:23 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Volume f13696b1-fbeb-47a9-9749-956aa9363064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f13696b1-fbeb-47a9-9749-956aa9363064', 'volume_size': 1} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:23 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3" returned: 0 in 0.671s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-eabbedb8-5d68-4ca7-bfc5-e584dfeef161 req-d0f686ac-28d1-481f-8111-d003e81a118f tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.093s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b6e895-c259-45bc-b575-66e1d47f6ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2624b34-e204-4a89-844f-9905f9526956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0abb7b-3f81-4967-84e4-1fa1c85bb389]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-eabbedb8-5d68-4ca7-bfc5-e584dfeef161 req-d0f686ac-28d1-481f-8111-d003e81a118f tempest-AttachVolumeTestJSON-1739532221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:23 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Volume volume-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3 (1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3): created successfully Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2624b34-e204-4a89-844f-9905f9526956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Flow 'volume_create_manager' (cf64fbf4-e6f1-49d3-b6b8-f8fc884299ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:17:23 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-0666e3c9-45eb-4a77-8105-84c9a45fd6d7 tempest-VolumesMetadataTest-1416142253 None] Created volume successfully. Jul 09 14:17:23 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e Jul 09 14:17:23 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:24 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-eabbedb8-5d68-4ca7-bfc5-e584dfeef161 req-d0f686ac-28d1-481f-8111-d003e81a118f tempest-AttachVolumeTestJSON-1739532221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e" returned: 0 in 0.791s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-eabbedb8-5d68-4ca7-bfc5-e584dfeef161 req-d0f686ac-28d1-481f-8111-d003e81a118f tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.819s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.118s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1665053026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13696b1-fbeb-47a9-9749-956aa9363064,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='73f054e423164c90940b767c8e1eee63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:17:23Z,use_quota=True,user_id='ecf030c34bb840d0bb697f437ad4f560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Creating volume f13696b1-fbeb-47a9-9749-956aa9363064 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:17:24 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f13696b1-fbeb-47a9-9749-956aa9363064 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:24 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f13696b1-fbeb-47a9-9749-956aa9363064 1073741824 Jul 09 14:17:24 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-eabbedb8-5d68-4ca7-bfc5-e584dfeef161 req-d0f686ac-28d1-481f-8111-d003e81a118f tempest-AttachVolumeTestJSON-1739532221 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aa939534-2bb5-465b-bf8b-81b33a4ccae1', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:17:24 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-eabbedb8-5d68-4ca7-bfc5-e584dfeef161 req-d0f686ac-28d1-481f-8111-d003e81a118f tempest-AttachVolumeTestJSON-1739532221 None] attachment_update completed successfully. Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] Acquiring lock "cinder-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] Lock "cinder-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] Acquiring lock "cinder-quobyte-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] Lock "cinder-quobyte-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3" acquired by "delete_volume" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d846f3e-8768-4aff-9e8a-171323530473]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:24 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3 Jul 09 14:17:24 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:25 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f13696b1-fbeb-47a9-9749-956aa9363064 1073741824" returned: 0 in 0.951s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f13696b1-fbeb-47a9-9749-956aa9363064 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:25 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f13696b1-fbeb-47a9-9749-956aa9363064 Jul 09 14:17:25 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:25 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3" returned: 0 in 1.017s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:25 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3 Jul 09 14:17:25 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:26 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f13696b1-fbeb-47a9-9749-956aa9363064" returned: 0 in 1.042s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:17:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a30f5d-f84d-444b-9453-9fa5a8099010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13696b1-fbeb-47a9-9749-956aa9363064', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74fafee-ab47-4d30-a9be-4e111e3d3ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:26 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Volume volume-f13696b1-fbeb-47a9-9749-956aa9363064 (f13696b1-fbeb-47a9-9749-956aa9363064): created successfully Jul 09 14:17:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74fafee-ab47-4d30-a9be-4e111e3d3ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Flow 'volume_create_manager' (ea8bf776-63dd-47e5-8635-99b069c107e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:17:26 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-2608de3f-27e2-4fef-b663-f0a999fe34e6 tempest-VolumesListTestJSON-757628808 None] Created volume successfully. Jul 09 14:17:26 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3" returned: 0 in 0.877s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] Lock "cinder-quobyte-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3" released by "delete_volume" :: held 1.943s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:26 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] Created reservations ['7c1f8125-759a-4823-9f0c-3fc989ceefde', 'acf4f000-038b-43ad-8bba-bf25682ce42d', '1fe7f35a-d1ab-43fd-8f4d-66cca98486d1', '30f644a4-5fda-40af-8015-87b68e3dd07f'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:17:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:26 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:17:26 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:27 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.667s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:27 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:17:27 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] Deleted volume successfully. Jul 09 14:17:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-90bb0840-b664-4149-87a6-6c16f8a815e8 tempest-VolumesMetadataTest-1416142253 None] Lock "cinder-1ee8ea3c-1d0d-4e1e-995e-d2595bae2ec3-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Flow 'volume_create_manager' (6f073a29-1252-4b14-adf6-d06e052874cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122f60e8-9946-4bcf-9807-489bbed2233f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122f60e8-9946-4bcf-9807-489bbed2233f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1809365017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c9cf66-3eef-47d5-8d82-84386026c4cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='73f054e423164c90940b767c8e1eee63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:17:28Z,use_quota=True,user_id='ecf030c34bb840d0bb697f437ad4f560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d2dae5-cc24-499a-b048-fd00c82f9e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d2dae5-cc24-499a-b048-fd00c82f9e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb8efedb-2955-4ece-9d4b-501182e9ddc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb8efedb-2955-4ece-9d4b-501182e9ddc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33c9cf66-3eef-47d5-8d82-84386026c4cc', 'volume_name': 'volume-33c9cf66-3eef-47d5-8d82-84386026c4cc', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9106885-9b0b-4172-9aa1-e404e597ba48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9106885-9b0b-4172-9aa1-e404e597ba48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b693b350-2f28-47a0-82bd-cd08ad53e097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:28 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Volume 33c9cf66-3eef-47d5-8d82-84386026c4cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33c9cf66-3eef-47d5-8d82-84386026c4cc', 'volume_size': 1} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1809365017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c9cf66-3eef-47d5-8d82-84386026c4cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='73f054e423164c90940b767c8e1eee63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:17:28Z,use_quota=True,user_id='ecf030c34bb840d0bb697f437ad4f560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Creating volume 33c9cf66-3eef-47d5-8d82-84386026c4cc {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:17:28 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:17:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33c9cf66-3eef-47d5-8d82-84386026c4cc 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:28 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33c9cf66-3eef-47d5-8d82-84386026c4cc 1073741824 Jul 09 14:17:28 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:29 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33c9cf66-3eef-47d5-8d82-84386026c4cc 1073741824" returned: 0 in 1.169s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33c9cf66-3eef-47d5-8d82-84386026c4cc {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:29 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33c9cf66-3eef-47d5-8d82-84386026c4cc Jul 09 14:17:29 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:30 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33c9cf66-3eef-47d5-8d82-84386026c4cc" returned: 0 in 0.969s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:30 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] <== create_volume: return (2190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:17:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b693b350-2f28-47a0-82bd-cd08ad53e097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33c9cf66-3eef-47d5-8d82-84386026c4cc', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89caeff4-3a1e-42f8-bbe1-da65fe3f3d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:30 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Volume volume-33c9cf66-3eef-47d5-8d82-84386026c4cc (33c9cf66-3eef-47d5-8d82-84386026c4cc): created successfully Jul 09 14:17:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89caeff4-3a1e-42f8-bbe1-da65fe3f3d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Flow 'volume_create_manager' (6f073a29-1252-4b14-adf6-d06e052874cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:17:30 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-17265e11-c2d6-40ff-bf78-ea0b8c010118 tempest-VolumesListTestJSON-757628808 None] Created volume successfully. Jul 09 14:17:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0e3c91e0-af77-48d1-b57b-361bd9b4fee1 tempest-VolumesActionsTest-558150910 None] Acquiring lock "cinder-4d742488-a85c-4bd5-9def-272478df2d4f" by "attach_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0e3c91e0-af77-48d1-b57b-361bd9b4fee1 tempest-VolumesActionsTest-558150910 None] Lock "cinder-4d742488-a85c-4bd5-9def-272478df2d4f" acquired by "attach_volume" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:30 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-0e3c91e0-af77-48d1-b57b-361bd9b4fee1 tempest-VolumesActionsTest-558150910 None] Attaching volume 4d742488-a85c-4bd5-9def-272478df2d4f to instance 1a562dc9-87f2-4e1c-a54a-57391dc52f3b at mountpoint /dev/vdb on host None. Jul 09 14:17:30 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-0e3c91e0-af77-48d1-b57b-361bd9b4fee1 tempest-VolumesActionsTest-558150910 None] Attach volume completed successfully. Jul 09 14:17:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0e3c91e0-af77-48d1-b57b-361bd9b4fee1 tempest-VolumesActionsTest-558150910 None] Lock "cinder-4d742488-a85c-4bd5-9def-272478df2d4f" released by "attach_volume" :: held 0.095s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4eb7a900-992f-405a-9018-f647642638ef tempest-VolumesActionsTest-558150910 None] Acquiring lock "cinder-4d742488-a85c-4bd5-9def-272478df2d4f-detach_volume" by "detach_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4eb7a900-992f-405a-9018-f647642638ef tempest-VolumesActionsTest-558150910 None] Lock "cinder-4d742488-a85c-4bd5-9def-272478df2d4f-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:31 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-4eb7a900-992f-405a-9018-f647642638ef tempest-VolumesActionsTest-558150910 None] Detaching volume 4d742488-a85c-4bd5-9def-272478df2d4f from instance 1a562dc9-87f2-4e1c-a54a-57391dc52f3b. Jul 09 14:17:31 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=104,cinder:DELETE=16,cinder:INSERT=32,cinder:UPDATE=111 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:17:31 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:DELETE=6,cinder:SELECT=101,cinder:INSERT=27,cinder:UPDATE=131 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:17:31 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-4eb7a900-992f-405a-9018-f647642638ef tempest-VolumesActionsTest-558150910 None] Detach volume completed successfully. Jul 09 14:17:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4eb7a900-992f-405a-9018-f647642638ef tempest-VolumesActionsTest-558150910 None] Lock "cinder-4d742488-a85c-4bd5-9def-272478df2d4f-detach_volume" released by "detach_volume" :: held 0.121s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:32 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-028394a5-5933-4be2-bacb-b9ab1d4ec842 req-61b80323-10b1-4579-bb35-b92046f4a290 tempest-AttachVolumeTestJSON-1739532221 None] Terminate volume connection completed successfully. Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-028394a5-5933-4be2-bacb-b9ab1d4ec842 req-61b80323-10b1-4579-bb35-b92046f4a290 tempest-AttachVolumeTestJSON-1739532221 None] Deleting attachment 24596e87-7241-4067-a00b-8aec576687ed. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Flow 'volume_create_manager' (27c3d7dc-b179-429e-9fa6-594f49045636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104399c8-4354-4fe2-8e5f-6597ef0ac155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104399c8-4354-4fe2-8e5f-6597ef0ac155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1505399562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd304d8-57aa-47b6-ba6f-b9f89285d3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba304a88c4b848a6a3ece11b4f9e4356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:17:33Z,use_quota=True,user_id='0f062f0211034c39a71a545bd2a9c2df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529e81ef-cc72-4933-aefe-574990cbd2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529e81ef-cc72-4933-aefe-574990cbd2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b2d195-4ea7-4006-beb0-23fca33ce5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b2d195-4ea7-4006-beb0-23fca33ce5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cd304d8-57aa-47b6-ba6f-b9f89285d3df', 'volume_name': 'volume-6cd304d8-57aa-47b6-ba6f-b9f89285d3df', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76caf0d5-75a8-47b5-a7d7-0c5c32cb5858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76caf0d5-75a8-47b5-a7d7-0c5c32cb5858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a072b252-93c8-4929-8995-94c48434d63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:32 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Volume 6cd304d8-57aa-47b6-ba6f-b9f89285d3df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cd304d8-57aa-47b6-ba6f-b9f89285d3df', 'volume_size': 1} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1505399562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd304d8-57aa-47b6-ba6f-b9f89285d3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba304a88c4b848a6a3ece11b4f9e4356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:17:33Z,use_quota=True,user_id='0f062f0211034c39a71a545bd2a9c2df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Creating volume 6cd304d8-57aa-47b6-ba6f-b9f89285d3df {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:17:32 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:17:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6cd304d8-57aa-47b6-ba6f-b9f89285d3df 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:32 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6cd304d8-57aa-47b6-ba6f-b9f89285d3df 1073741824 Jul 09 14:17:32 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:33 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6cd304d8-57aa-47b6-ba6f-b9f89285d3df 1073741824" returned: 0 in 1.072s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6cd304d8-57aa-47b6-ba6f-b9f89285d3df {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:34 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6cd304d8-57aa-47b6-ba6f-b9f89285d3df Jul 09 14:17:34 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:34 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-672a519b-6380-4f48-a5c8-139a88ca6092 req-3554b1a0-f3f6-4c95-8dfa-7b8ecfe22bc7 tempest-AttachVolumeTestJSON-1739532221 None] Terminate volume connection completed successfully. Jul 09 14:17:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-672a519b-6380-4f48-a5c8-139a88ca6092 req-3554b1a0-f3f6-4c95-8dfa-7b8ecfe22bc7 tempest-AttachVolumeTestJSON-1739532221 None] Deleting attachment aa939534-2bb5-465b-bf8b-81b33a4ccae1. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:17:35 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6cd304d8-57aa-47b6-ba6f-b9f89285d3df" returned: 0 in 0.978s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:17:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.128s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a072b252-93c8-4929-8995-94c48434d63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cd304d8-57aa-47b6-ba6f-b9f89285d3df', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae98ed52-7fe6-452d-83c9-6bffee01fe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:35 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Volume volume-6cd304d8-57aa-47b6-ba6f-b9f89285d3df (6cd304d8-57aa-47b6-ba6f-b9f89285d3df): created successfully Jul 09 14:17:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae98ed52-7fe6-452d-83c9-6bffee01fe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Flow 'volume_create_manager' (27c3d7dc-b179-429e-9fa6-594f49045636) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:17:35 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-8c1a623a-0537-425c-a02c-22867d7c7153 tempest-VolumesTransfersTest-1325191358 None] Created volume successfully. Jul 09 14:17:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] Acquiring lock "cinder-33c9cf66-3eef-47d5-8d82-84386026c4cc-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] Lock "cinder-33c9cf66-3eef-47d5-8d82-84386026c4cc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] Acquiring lock "cinder-quobyte-33c9cf66-3eef-47d5-8d82-84386026c4cc" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] Lock "cinder-quobyte-33c9cf66-3eef-47d5-8d82-84386026c4cc" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:35 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fc4260-5d40-4adc-93ef-43ff4faae36d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33c9cf66-3eef-47d5-8d82-84386026c4cc {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:35 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33c9cf66-3eef-47d5-8d82-84386026c4cc Jul 09 14:17:35 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:36 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33c9cf66-3eef-47d5-8d82-84386026c4cc" returned: 0 in 0.830s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33c9cf66-3eef-47d5-8d82-84386026c4cc {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:36 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33c9cf66-3eef-47d5-8d82-84386026c4cc Jul 09 14:17:36 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:36 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-55b08110-bab5-418f-ab98-957032d0ecd9 tempest-VolumesTransfersTest-588913401 None] Transfer volume completed successfully. Jul 09 14:17:36 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33c9cf66-3eef-47d5-8d82-84386026c4cc" returned: 0 in 0.701s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] Lock "cinder-quobyte-33c9cf66-3eef-47d5-8d82-84386026c4cc" released by "delete_volume" :: held 1.571s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:36 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] Created reservations ['0249d6d4-2cef-4f15-bbd6-a4a00f520d5b', 'bea7f76e-384c-4c52-a7df-dc8fdbe97592', '6b3d9f65-332d-4c7e-82e7-b4c19093e52a', '767b7154-2e3a-4ebc-ae28-9b153b9781d8'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:17:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:37 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:17:37 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] Acquiring lock "cinder-f13696b1-fbeb-47a9-9749-956aa9363064-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] Lock "cinder-f13696b1-fbeb-47a9-9749-956aa9363064-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] Acquiring lock "cinder-quobyte-f13696b1-fbeb-47a9-9749-956aa9363064" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] Lock "cinder-quobyte-f13696b1-fbeb-47a9-9749-956aa9363064" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:37 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[942b3b8f-7d72-4b48-8a04-7c509bee9225]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f13696b1-fbeb-47a9-9749-956aa9363064 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:37 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.817s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:37 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:17:37 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] Deleted volume successfully. Jul 09 14:17:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-329f0f1c-ec53-471c-809a-02ca313f5aa7 tempest-VolumesListTestJSON-757628808 None] Lock "cinder-33c9cf66-3eef-47d5-8d82-84386026c4cc-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] Acquiring lock "cinder-6cd304d8-57aa-47b6-ba6f-b9f89285d3df-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] Lock "cinder-6cd304d8-57aa-47b6-ba6f-b9f89285d3df-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:37 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f13696b1-fbeb-47a9-9749-956aa9363064 Jul 09 14:17:37 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] Acquiring lock "cinder-quobyte-6cd304d8-57aa-47b6-ba6f-b9f89285d3df" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] Lock "cinder-quobyte-6cd304d8-57aa-47b6-ba6f-b9f89285d3df" acquired by "delete_volume" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:37 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7fb67d-4261-4aa4-bdec-8dc97f99a9f2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6cd304d8-57aa-47b6-ba6f-b9f89285d3df {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:38 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6cd304d8-57aa-47b6-ba6f-b9f89285d3df Jul 09 14:17:38 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:38 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f13696b1-fbeb-47a9-9749-956aa9363064" returned: 0 in 0.887s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f13696b1-fbeb-47a9-9749-956aa9363064 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:38 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f13696b1-fbeb-47a9-9749-956aa9363064 Jul 09 14:17:38 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:38 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6cd304d8-57aa-47b6-ba6f-b9f89285d3df" returned: 0 in 0.872s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6cd304d8-57aa-47b6-ba6f-b9f89285d3df {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:38 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6cd304d8-57aa-47b6-ba6f-b9f89285d3df Jul 09 14:17:38 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:39 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f13696b1-fbeb-47a9-9749-956aa9363064" returned: 0 in 0.846s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:39 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] Lock "cinder-quobyte-f13696b1-fbeb-47a9-9749-956aa9363064" released by "delete_volume" :: held 1.793s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:39 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] Created reservations ['fc997ec8-f19e-4f98-8db2-fe847fc70658', '28fc72e7-50fe-460c-bc34-94a9779711fe', '0464e03f-2b93-4cc8-a83f-8e4edece080a', '9e08709b-8def-499f-8827-56c57bfe9904'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:17:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:39 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:17:39 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:39 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6cd304d8-57aa-47b6-ba6f-b9f89285d3df" returned: 0 in 0.877s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:39 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] Lock "cinder-quobyte-6cd304d8-57aa-47b6-ba6f-b9f89285d3df" released by "delete_volume" :: held 1.796s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:39 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] Created reservations ['3de26722-8b0d-4b11-b963-70fc76ff67df', 'ac2444f2-fa14-4bd9-b926-852f7ed105ce', '72636fed-a9a4-4aae-a3b6-1d8286291e42', '3adf791e-5865-4eba-8628-a57620272bcd'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:17:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:39 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:17:39 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] Acquiring lock "cinder-0a124ade-cc46-4d03-ae1a-98a2dc717d5e-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] Lock "cinder-0a124ade-cc46-4d03-ae1a-98a2dc717d5e-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] Acquiring lock "cinder-quobyte-0a124ade-cc46-4d03-ae1a-98a2dc717d5e" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] Lock "cinder-quobyte-0a124ade-cc46-4d03-ae1a-98a2dc717d5e" acquired by "delete_volume" :: waited 0.039s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:40 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6798096f-bcc6-454f-8aed-0aa7fe387c40]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a124ade-cc46-4d03-ae1a-98a2dc717d5e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:40 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a124ade-cc46-4d03-ae1a-98a2dc717d5e Jul 09 14:17:40 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:40 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.078s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:40 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:17:40 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] Deleted volume successfully. Jul 09 14:17:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8dbbfac5-b4c2-4168-ae9c-210ccee1a091 tempest-VolumesListTestJSON-757628808 None] Lock "cinder-f13696b1-fbeb-47a9-9749-956aa9363064-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Flow 'volume_create_manager' (974d547f-791f-4b9a-8c43-f71774f5b5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc72875-78c7-4161-a18a-54bf7003ba2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc72875-78c7-4161-a18a-54bf7003ba2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1777007246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a12035-46d0-4410-b8ee-c0ed3638d47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba304a88c4b848a6a3ece11b4f9e4356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:17:41Z,use_quota=True,user_id='0f062f0211034c39a71a545bd2a9c2df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a3f071-c857-4964-8655-b2077a9329e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a3f071-c857-4964-8655-b2077a9329e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a59185-435b-431d-89f7-528974c6ae42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a59185-435b-431d-89f7-528974c6ae42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a12035-46d0-4410-b8ee-c0ed3638d47c', 'volume_name': 'volume-02a12035-46d0-4410-b8ee-c0ed3638d47c', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a010ae-1fab-42ed-9866-a35b3b6d260b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23a010ae-1fab-42ed-9866-a35b3b6d260b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c31a49-0be9-4a37-abf9-b777566427d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:41 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Volume 02a12035-46d0-4410-b8ee-c0ed3638d47c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a12035-46d0-4410-b8ee-c0ed3638d47c', 'volume_size': 1} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1777007246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a12035-46d0-4410-b8ee-c0ed3638d47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba304a88c4b848a6a3ece11b4f9e4356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:17:41Z,use_quota=True,user_id='0f062f0211034c39a71a545bd2a9c2df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Creating volume 02a12035-46d0-4410-b8ee-c0ed3638d47c {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:17:41 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-02a12035-46d0-4410-b8ee-c0ed3638d47c 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:41 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.420s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:17:41 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-02a12035-46d0-4410-b8ee-c0ed3638d47c 1073741824 Jul 09 14:17:41 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:41 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] Deleted volume successfully. Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2d57d6cb-336f-4a2f-bb5f-f908332f2235 tempest-VolumesTransfersTest-1449396281 None] Lock "cinder-6cd304d8-57aa-47b6-ba6f-b9f89285d3df-delete_volume" released by "delete_volume" :: held 3.553s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:41 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a124ade-cc46-4d03-ae1a-98a2dc717d5e" returned: 0 in 1.185s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a124ade-cc46-4d03-ae1a-98a2dc717d5e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:41 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a124ade-cc46-4d03-ae1a-98a2dc717d5e Jul 09 14:17:41 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5fdd6f37-228e-47a3-861d-cf51a44caa86 tempest-VolumesActionsTest-558150910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:42 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a124ade-cc46-4d03-ae1a-98a2dc717d5e" returned: 0 in 0.829s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:42 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] Lock "cinder-quobyte-0a124ade-cc46-4d03-ae1a-98a2dc717d5e" released by "delete_volume" :: held 2.085s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:42 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] Created reservations ['0a481f16-769b-4b8b-a735-5dedd4c96f9b', '00a61bad-65aa-41ec-8282-74492a4b16ec', '47e52a28-5cb6-4f69-9a4a-fbb1cad38575', '93a8c032-eb6d-4964-99c5-7ae64f4bb70f'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:17:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:42 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-02a12035-46d0-4410-b8ee-c0ed3638d47c 1073741824" returned: 0 in 1.130s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:42 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:17:42 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-02a12035-46d0-4410-b8ee-c0ed3638d47c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:42 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-02a12035-46d0-4410-b8ee-c0ed3638d47c Jul 09 14:17:42 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:43 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.737s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:43 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:17:43 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] Deleted volume successfully. Jul 09 14:17:43 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c3d1e97a-3b8c-435f-9ca9-e2a157564e34 tempest-VolumesListTestJSON-757628808 None] Lock "cinder-0a124ade-cc46-4d03-ae1a-98a2dc717d5e-delete_volume" released by "delete_volume" :: held 3.134s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:43 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-02a12035-46d0-4410-b8ee-c0ed3638d47c" returned: 0 in 0.750s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:43 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:17:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5fdd6f37-228e-47a3-861d-cf51a44caa86 tempest-VolumesActionsTest-558150910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.030s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c31a49-0be9-4a37-abf9-b777566427d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a12035-46d0-4410-b8ee-c0ed3638d47c', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5dd66fd-a2fc-41c7-a92c-25a797ad2b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:43 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aa11b7-a538-4ce1-9fc6-34be56cc0920]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5fdd6f37-228e-47a3-861d-cf51a44caa86 tempest-VolumesActionsTest-558150910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:43 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Volume volume-02a12035-46d0-4410-b8ee-c0ed3638d47c (02a12035-46d0-4410-b8ee-c0ed3638d47c): created successfully Jul 09 14:17:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5dd66fd-a2fc-41c7-a92c-25a797ad2b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Flow 'volume_create_manager' (974d547f-791f-4b9a-8c43-f71774f5b5b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:17:43 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-929b873e-cc4a-47af-8cf3-f657a6f13f2d tempest-VolumesTransfersTest-1325191358 None] Created volume successfully. Jul 09 14:17:43 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f Jul 09 14:17:43 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:44 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5fdd6f37-228e-47a3-861d-cf51a44caa86 tempest-VolumesActionsTest-558150910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f" returned: 0 in 0.833s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:44 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b26d17-597a-4ac6-bad3-f75d2c9a9ed4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5fdd6f37-228e-47a3-861d-cf51a44caa86 tempest-VolumesActionsTest-558150910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:44 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f Jul 09 14:17:44 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:44 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] Acquiring lock "cinder-02a12035-46d0-4410-b8ee-c0ed3638d47c-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:44 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] Lock "cinder-02a12035-46d0-4410-b8ee-c0ed3638d47c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:44 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] Acquiring lock "cinder-quobyte-02a12035-46d0-4410-b8ee-c0ed3638d47c" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:44 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] Lock "cinder-quobyte-02a12035-46d0-4410-b8ee-c0ed3638d47c" acquired by "delete_volume" :: waited 0.014s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:44 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[a139a780-c9a9-4399-ad5c-7c558d7cb27e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-02a12035-46d0-4410-b8ee-c0ed3638d47c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:44 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-02a12035-46d0-4410-b8ee-c0ed3638d47c Jul 09 14:17:44 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:45 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5fdd6f37-228e-47a3-861d-cf51a44caa86 tempest-VolumesActionsTest-558150910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f" returned: 0 in 0.925s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5fdd6f37-228e-47a3-861d-cf51a44caa86 tempest-VolumesActionsTest-558150910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.580761a0-9517-476e-8739-57e92bd340c7mmyv7ele.img {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:45 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.580761a0-9517-476e-8739-57e92bd340c7mmyv7ele.img Jul 09 14:17:45 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:45 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-02a12035-46d0-4410-b8ee-c0ed3638d47c" returned: 0 in 0.964s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-02a12035-46d0-4410-b8ee-c0ed3638d47c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:45 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-02a12035-46d0-4410-b8ee-c0ed3638d47c Jul 09 14:17:45 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:47 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-02a12035-46d0-4410-b8ee-c0ed3638d47c" returned: 0 in 1.535s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] Lock "cinder-quobyte-02a12035-46d0-4410-b8ee-c0ed3638d47c" released by "delete_volume" :: held 2.579s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] Acquiring lock "cinder-f167aac2-472c-4a49-9d0f-4e156b3b2c6e-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] Lock "cinder-f167aac2-472c-4a49-9d0f-4e156b3b2c6e-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:47 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] Created reservations ['43289612-d952-4dc3-a560-446a8d8adb33', '113e2673-3ec4-4a43-8513-0fda95fb48af', 'eddca6c0-7af0-43a5-b13e-990b01460a4f', 'ba5fe32d-61be-4b77-8ed4-8bcf56d679b2'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:17:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] Acquiring lock "cinder-quobyte-f167aac2-472c-4a49-9d0f-4e156b3b2c6e" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] Lock "cinder-quobyte-f167aac2-472c-4a49-9d0f-4e156b3b2c6e" acquired by "delete_volume" :: waited 0.053s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:47 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb367fae-251d-4deb-a701-ce9474fa2e6b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:47 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:17:47 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:47 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e Jul 09 14:17:47 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:49 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e" returned: 0 in 1.812s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:49 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e Jul 09 14:17:49 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:49 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.768s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:49 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:17:49 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] Deleted volume successfully. Jul 09 14:17:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d04b8fac-b3e4-420a-abef-d115019c5329 tempest-VolumesTransfersTest-1449396281 None] Lock "cinder-02a12035-46d0-4410-b8ee-c0ed3638d47c-delete_volume" released by "delete_volume" :: held 4.958s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:51 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f167aac2-472c-4a49-9d0f-4e156b3b2c6e" returned: 0 in 1.546s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] Lock "cinder-quobyte-f167aac2-472c-4a49-9d0f-4e156b3b2c6e" released by "delete_volume" :: held 3.453s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:51 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] Created reservations ['39039c2c-958a-4201-aa53-718429cf1373', '59e69463-6c41-43a0-a763-d127e7512bf4', '7ca53dde-331c-471b-8dd5-3efe004be261', '25c32b14-f0c5-43a6-9d1c-9340e28e1db5'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:17:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:51 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:17:51 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:51 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5fdd6f37-228e-47a3-861d-cf51a44caa86 tempest-VolumesActionsTest-558150910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.580761a0-9517-476e-8739-57e92bd340c7mmyv7ele.img" returned: 0 in 6.243s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:51 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8be9e9-ac8b-45c4-b6aa-d70fa95fb36e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5fdd6f37-228e-47a3-861d-cf51a44caa86 tempest-VolumesActionsTest-558150910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:51 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f Jul 09 14:17:51 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:52 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.810s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:52 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:17:52 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] Deleted volume successfully. Jul 09 14:17:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2d8bd442-444d-4995-9fc1-bc888d7768ad tempest-AttachVolumeTestJSON-1739532221 None] Lock "cinder-f167aac2-472c-4a49-9d0f-4e156b3b2c6e-delete_volume" released by "delete_volume" :: held 4.702s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] Acquiring lock "cinder-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] Lock "cinder-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] Acquiring lock "cinder-quobyte-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] Lock "cinder-quobyte-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8" acquired by "delete_volume" :: waited 0.036s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:52 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[609aae30-8106-48d5-8e7b-5f560fc65b53]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:52 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8 Jul 09 14:17:52 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:52 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5fdd6f37-228e-47a3-861d-cf51a44caa86 tempest-VolumesActionsTest-558150910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f" returned: 0 in 1.248s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:52 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-5fdd6f37-228e-47a3-861d-cf51a44caa86 tempest-VolumesActionsTest-558150910 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.580761a0-9517-476e-8739-57e92bd340c7mmyv7ele.img {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:17:52 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-5fdd6f37-228e-47a3-861d-cf51a44caa86 tempest-VolumesActionsTest-558150910 None] Converted 1024.00 MB image at 163.98 MB/s Jul 09 14:17:52 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-5fdd6f37-228e-47a3-861d-cf51a44caa86 tempest-VolumesActionsTest-558150910 None] 580761a0-9517-476e-8739-57e92bd340c7 was raw, no need to convert to raw {{(pid=87011) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 09 14:17:53 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8" returned: 0 in 1.257s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:53 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8 Jul 09 14:17:53 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:54 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8" returned: 0 in 0.803s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] Lock "cinder-quobyte-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8" released by "delete_volume" :: held 2.131s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:54 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] Created reservations ['0fe4f442-185e-4384-8fa6-1053f837bb9c', 'ec144c9e-2eb3-4f74-8be7-ba24c39d302d', '7384cd18-cb79-4e3a-83ef-2aa9b5030f8a', '370ef1e7-ed94-4d8e-a8ee-1c8ab7ce04af'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:17:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:54 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:17:54 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:55 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.930s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:55 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:17:55 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] Deleted volume successfully. Jul 09 14:17:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4479247e-7e45-498e-b05a-5b01f59d131c tempest-AttachVolumeTestJSON-1739532221 None] Lock "cinder-c48daed8-4dbf-4dfa-8d14-05ee4999c2c8-delete_volume" released by "delete_volume" :: held 3.391s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] Acquiring lock "cinder-c0465182-26e4-47d9-9bf8-ed3f5282de9f-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] Lock "cinder-c0465182-26e4-47d9-9bf8-ed3f5282de9f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] Acquiring lock "cinder-quobyte-c0465182-26e4-47d9-9bf8-ed3f5282de9f" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:17:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] Lock "cinder-quobyte-c0465182-26e4-47d9-9bf8-ed3f5282de9f" acquired by "delete_volume" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:17:55 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c24d755-59c1-46b8-925e-e4ce5792d51b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:17:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:56 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f Jul 09 14:17:56 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:57 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f" returned: 0 in 1.290s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:57 devstack sudo[97660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f Jul 09 14:17:57 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:58 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c0465182-26e4-47d9-9bf8-ed3f5282de9f" returned: 0 in 0.969s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] Lock "cinder-quobyte-c0465182-26e4-47d9-9bf8-ed3f5282de9f" released by "delete_volume" :: held 2.328s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] Created reservations ['cc1271a6-9f6d-4266-b019-e344d22bbc61', '762de104-c5e2-4d05-bc3c-c58ffd0458f2', 'b7ff6c12-7575-4091-9056-9d7de69f2b8b', '79ea463e-d676-457c-b4bb-772bc2555bcc'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Flow 'volume_create_manager' (d8002cb4-e20b-4ef1-967c-b1b0807907f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1dc687d-9b0e-44ca-8077-7f29606b5cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1dc687d-9b0e-44ca-8077-7f29606b5cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1169361137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a710fa37-1306-41b0-b8fb-e58b3b95f3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4015601ee1c647dab7c4890e548d2a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:17:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:17:58Z,use_quota=True,user_id='128aeb703d1f48309e479d13c050050d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750c246c-d126-4f46-8644-c671014a02de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750c246c-d126-4f46-8644-c671014a02de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d5b6c72-3eaf-4fdc-aeaf-56939610c1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d5b6c72-3eaf-4fdc-aeaf-56939610c1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a710fa37-1306-41b0-b8fb-e58b3b95f3e3', 'volume_name': 'volume-a710fa37-1306-41b0-b8fb-e58b3b95f3e3', 'volume_size': 2}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05cbb783-59f4-4a5e-9808-1a1f94a1b037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05cbb783-59f4-4a5e-9808-1a1f94a1b037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b25e14-21c2-4835-b40f-5449360118ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:17:58 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Volume a710fa37-1306-41b0-b8fb-e58b3b95f3e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a710fa37-1306-41b0-b8fb-e58b3b95f3e3', 'volume_size': 2} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:17:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:17:58 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:17:58 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:17:59 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Jul 09 14:17:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.822s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:17:59 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:17:59 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] Deleted volume successfully. Jul 09 14:17:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf952bce-0185-4277-872d-a32f201ab55f tempest-AttachVolumeTestJSON-1739532221 None] Lock "cinder-c0465182-26e4-47d9-9bf8-ed3f5282de9f-delete_volume" released by "delete_volume" :: held 3.783s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:18:01 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:18:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Flow 'volume_create_manager' (585ebf82-ec9c-4902-9f59-58bf8f28ae67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:18:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7de8450-946d-42d0-9471-974884eb8e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7de8450-946d-42d0-9471-974884eb8e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-138475894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b24eb56-5c8d-498d-8dd0-ca2890cba4b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8449f98c569944df9b37db8ac7f2b56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:18:02Z,use_quota=True,user_id='f8e98e41e8c849899537910621e35e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5a4167-6cef-46a3-b0bc-80a368712a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5a4167-6cef-46a3-b0bc-80a368712a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cf6b71-d5b1-4f47-860c-83cff079ccb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cf6b71-d5b1-4f47-860c-83cff079ccb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b24eb56-5c8d-498d-8dd0-ca2890cba4b5', 'volume_name': 'volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcdde462-1855-4a8d-87ac-d5e41cb1cb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcdde462-1855-4a8d-87ac-d5e41cb1cb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530d9836-475a-4ad5-82a2-8ea5de1bc9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:01 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Volume 2b24eb56-5c8d-498d-8dd0-ca2890cba4b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5', 'volume_size': 1} Jul 09 14:18:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:08 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:18:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Flow 'volume_create_manager' (62647757-689d-4aea-b1d7-08dc4bf10d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:18:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8665c6e2-e692-44e0-abfb-9e85a9049dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8665c6e2-e692-44e0-abfb-9e85a9049dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1393170955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c83f76-f753-40b4-abc4-cdf89116ab3c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0f072d59e62448fb7ece5cd1359a260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:18:09Z,use_quota=True,user_id='d64cb94d44ba416b9cf506012c185f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d633ea5-9a2f-4902-81c5-d8cbfaf0f8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d633ea5-9a2f-4902-81c5-d8cbfaf0f8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba658e16-1c5e-45e8-8f01-c09dc3fef3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba658e16-1c5e-45e8-8f01-c09dc3fef3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4c83f76-f753-40b4-abc4-cdf89116ab3c', 'volume_name': 'volume-b4c83f76-f753-40b4-abc4-cdf89116ab3c', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd454b5-c7c0-42fb-a3d8-97e2cf0dcc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd454b5-c7c0-42fb-a3d8-97e2cf0dcc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22974707-b68e-4920-95d3-273c50dd7630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:08 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Volume b4c83f76-f753-40b4-abc4-cdf89116ab3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4c83f76-f753-40b4-abc4-cdf89116ab3c', 'volume_size': 1} Jul 09 14:18:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:18:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:18:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:18:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:12 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:18:12 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:13 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.648s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:18:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:18:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:18:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:18:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5fdd6f37-228e-47a3-861d-cf51a44caa86 tempest-VolumesActionsTest-558150910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.682s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5fdd6f37-228e-47a3-861d-cf51a44caa86 tempest-VolumesActionsTest-558150910 None] Uploaded volume to glance image-id: 580761a0-9517-476e-8739-57e92bd340c7. {{(pid=87011) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 14:18:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.316s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1169361137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a710fa37-1306-41b0-b8fb-e58b3b95f3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4015601ee1c647dab7c4890e548d2a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:17:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:17:58Z,use_quota=True,user_id='128aeb703d1f48309e479d13c050050d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:18:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Creating volume a710fa37-1306-41b0-b8fb-e58b3b95f3e3 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:18:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:18:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:18:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:18:15 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:18:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a710fa37-1306-41b0-b8fb-e58b3b95f3e3 2147483648 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:15 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a710fa37-1306-41b0-b8fb-e58b3b95f3e3 2147483648 Jul 09 14:18:15 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:15 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-5fdd6f37-228e-47a3-861d-cf51a44caa86 tempest-VolumesActionsTest-558150910 None] Copy volume to image completed successfully. Jul 09 14:18:16 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a710fa37-1306-41b0-b8fb-e58b3b95f3e3 2147483648" returned: 0 in 0.841s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a710fa37-1306-41b0-b8fb-e58b3b95f3e3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:16 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a710fa37-1306-41b0-b8fb-e58b3b95f3e3 Jul 09 14:18:16 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:17 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a710fa37-1306-41b0-b8fb-e58b3b95f3e3" returned: 0 in 0.651s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.659s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-138475894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b24eb56-5c8d-498d-8dd0-ca2890cba4b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8449f98c569944df9b37db8ac7f2b56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:18:02Z,use_quota=True,user_id='f8e98e41e8c849899537910621e35e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Creating volume 2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:18:17 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:17 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 1073741824 Jul 09 14:18:17 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b25e14-21c2-4835-b40f-5449360118ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a710fa37-1306-41b0-b8fb-e58b3b95f3e3', 'volume_size': 2}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bccd589a-8620-41d4-93a2-668759b1264e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:17 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Volume volume-a710fa37-1306-41b0-b8fb-e58b3b95f3e3 (a710fa37-1306-41b0-b8fb-e58b3b95f3e3): created successfully Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bccd589a-8620-41d4-93a2-668759b1264e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Flow 'volume_create_manager' (d8002cb4-e20b-4ef1-967c-b1b0807907f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:18:17 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-1b9e6c45-9426-48b7-9418-008243a6ccb6 tempest-VolumesCloneNegativeTest-1808934643 None] Created volume successfully. Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] Acquiring lock "cinder-a710fa37-1306-41b0-b8fb-e58b3b95f3e3-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] Lock "cinder-a710fa37-1306-41b0-b8fb-e58b3b95f3e3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] Acquiring lock "cinder-quobyte-a710fa37-1306-41b0-b8fb-e58b3b95f3e3" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] Lock "cinder-quobyte-a710fa37-1306-41b0-b8fb-e58b3b95f3e3" acquired by "delete_volume" :: waited 0.028s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[34df45a3-ca99-4153-bf97-f4ec4cdeab69]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a710fa37-1306-41b0-b8fb-e58b3b95f3e3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:18 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a710fa37-1306-41b0-b8fb-e58b3b95f3e3 Jul 09 14:18:18 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:18 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 1073741824" returned: 0 in 0.857s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:18 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 Jul 09 14:18:18 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:18 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a710fa37-1306-41b0-b8fb-e58b3b95f3e3" returned: 0 in 0.780s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a710fa37-1306-41b0-b8fb-e58b3b95f3e3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:18 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a710fa37-1306-41b0-b8fb-e58b3b95f3e3 Jul 09 14:18:18 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:19 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5" returned: 0 in 0.637s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.128s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1393170955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c83f76-f753-40b4-abc4-cdf89116ab3c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0f072d59e62448fb7ece5cd1359a260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:18:09Z,use_quota=True,user_id='d64cb94d44ba416b9cf506012c185f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Creating volume b4c83f76-f753-40b4-abc4-cdf89116ab3c {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:18:19 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b4c83f76-f753-40b4-abc4-cdf89116ab3c 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:19 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b4c83f76-f753-40b4-abc4-cdf89116ab3c 1073741824 Jul 09 14:18:19 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530d9836-475a-4ad5-82a2-8ea5de1bc9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de72c8e6-bf39-4ef9-a9dc-f5ff0cc2659f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:19 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Volume volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 (2b24eb56-5c8d-498d-8dd0-ca2890cba4b5): created successfully Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de72c8e6-bf39-4ef9-a9dc-f5ff0cc2659f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Flow 'volume_create_manager' (585ebf82-ec9c-4902-9f59-58bf8f28ae67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:18:19 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-2a2c06c3-d6e4-443a-9c5b-d37106784df9 tempest-VolumesSnapshotTestJSON-1345456126 None] Created volume successfully. Jul 09 14:18:19 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a710fa37-1306-41b0-b8fb-e58b3b95f3e3" returned: 0 in 0.622s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] Lock "cinder-quobyte-a710fa37-1306-41b0-b8fb-e58b3b95f3e3" released by "delete_volume" :: held 1.441s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] Created reservations ['e2f6e4e7-cf1b-4ab0-8913-d344160a6431', 'cfc0cbb1-9752-4356-a25a-aae2c380162b', 'b53a2ba9-868a-4b46-8dc4-dbf80bc416f1', 'c99bdbcf-a5f7-4d58-a6db-f501ee062c8e'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:19 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:18:19 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:19 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b4c83f76-f753-40b4-abc4-cdf89116ab3c 1073741824" returned: 0 in 0.836s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b4c83f76-f753-40b4-abc4-cdf89116ab3c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:19 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b4c83f76-f753-40b4-abc4-cdf89116ab3c Jul 09 14:18:19 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:20 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.715s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:20 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:18:20 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] Deleted volume successfully. Jul 09 14:18:20 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b4c83f76-f753-40b4-abc4-cdf89116ab3c" returned: 0 in 0.770s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:18:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.867s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:20 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[255c129a-3d97-4b1d-b4b6-b5b274c694e7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:20 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f Jul 09 14:18:20 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22974707-b68e-4920-95d3-273c50dd7630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4c83f76-f753-40b4-abc4-cdf89116ab3c', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3c6289-abc3-4f09-bffc-fcdc6257b2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:20 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fe4d1dfa-fd01-475a-8c92-b0ab631191cf tempest-VolumesCloneNegativeTest-1808934643 None] Lock "cinder-a710fa37-1306-41b0-b8fb-e58b3b95f3e3-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:18:20 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Volume volume-b4c83f76-f753-40b4-abc4-cdf89116ab3c (b4c83f76-f753-40b4-abc4-cdf89116ab3c): created successfully Jul 09 14:18:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3c6289-abc3-4f09-bffc-fcdc6257b2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Flow 'volume_create_manager' (62647757-689d-4aea-b1d7-08dc4bf10d17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:18:21 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-276a320f-0d4e-4bfb-9680-5797c0558e2a req-fc7b2305-38a1-423e-a1ca-56765da19be6 tempest-VolumesGetTestJSON-1810586814 None] Created volume successfully. Jul 09 14:18:21 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f" returned: 0 in 0.846s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:21 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[25de8ca2-c656-450c-9e2c-8c400cb9f480]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:21 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f Jul 09 14:18:21 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] Acquiring lock "cinder-b4c83f76-f753-40b4-abc4-cdf89116ab3c-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] Lock "cinder-b4c83f76-f753-40b4-abc4-cdf89116ab3c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] Acquiring lock "cinder-quobyte-b4c83f76-f753-40b4-abc4-cdf89116ab3c" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] Lock "cinder-quobyte-b4c83f76-f753-40b4-abc4-cdf89116ab3c" acquired by "delete_volume" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:22 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eff9c3-5bd9-4898-8739-f48c994c6069]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b4c83f76-f753-40b4-abc4-cdf89116ab3c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:22 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b4c83f76-f753-40b4-abc4-cdf89116ab3c Jul 09 14:18:22 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:22 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f" returned: 0 in 0.986s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.082ed88c-1b3f-4d8f-931b-9052bd9e64017hfij0pq.img {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:22 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.082ed88c-1b3f-4d8f-931b-9052bd9e64017hfij0pq.img Jul 09 14:18:22 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:23 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b4c83f76-f753-40b4-abc4-cdf89116ab3c" returned: 0 in 0.786s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b4c83f76-f753-40b4-abc4-cdf89116ab3c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:23 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b4c83f76-f753-40b4-abc4-cdf89116ab3c Jul 09 14:18:23 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:24 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b4c83f76-f753-40b4-abc4-cdf89116ab3c" returned: 0 in 1.165s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] Lock "cinder-quobyte-b4c83f76-f753-40b4-abc4-cdf89116ab3c" released by "delete_volume" :: held 2.033s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:18:24 devstack cinder-volume[87011]: DEBUG cinder.quota [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] Created reservations ['5b368023-7e34-4004-8a04-6b43b1e1cfaf', '4c21113c-993b-4dcf-a06d-750d4a50d5b1', '8541acd1-d091-4387-ac8c-887228a85223', 'c95929d2-ea2d-4a36-8ec5-625bb5d4bd34'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:18:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:18:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:18:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:24 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:18:24 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:25 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:18:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Flow 'volume_create_manager' (d6dccf38-a5fc-49ce-8cf9-bc49a1cb3c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:18:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a67659-103f-4217-9f77-ce31b96430a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a67659-103f-4217-9f77-ce31b96430a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-950479086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0912ae16-bc36-42cb-ba70-6e8401f02f5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9058cb18077f4f2aa65c49aec22f72f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:18:26Z,use_quota=True,user_id='e3678ff9c2054e068965bcc80a7405d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fd3a6d-5adf-4429-9492-0f38d7738360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fd3a6d-5adf-4429-9492-0f38d7738360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22254ba6-5b5c-44ee-88c5-b258d64971fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:25 devstack cinder-volume[87011]: DEBUG cinder.image.glance [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Creating Keystone auth plugin from conf {{(pid=87011) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 14:18:26 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.536s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:26 devstack cinder-volume[87011]: DEBUG cinder.manager [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:18:26 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] Deleted volume successfully. Jul 09 14:18:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-f1261cfa-e38a-4900-9611-0ba63d751d1d req-80a7e4e5-2f9a-4cf1-9697-d5833e414739 tempest-VolumesGetTestJSON-1810586814 None] Lock "cinder-b4c83f76-f753-40b4-abc4-cdf89116ab3c-delete_volume" released by "delete_volume" :: held 4.134s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:18:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22254ba6-5b5c-44ee-88c5-b258d64971fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0912ae16-bc36-42cb-ba70-6e8401f02f5c', 'volume_name': 'volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c', 'volume_size': 1, 'image_id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c87c562978df4c18bad93b074708151d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'created_at': datetime.datetime(2026, 7, 9, 12, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fed42dad-a967-43d7-aa04-dfd40efa81d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e53a763-0756-4700-bc14-0eb8f3ca383e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e53a763-0756-4700-bc14-0eb8f3ca383e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f29893-9182-4040-a6b5-5c2b527981a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:26 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Volume 0912ae16-bc36-42cb-ba70-6e8401f02f5c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c', 'volume_size': 1, 'image_id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c87c562978df4c18bad93b074708151d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'created_at': datetime.datetime(2026, 7, 9, 12, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fed42dad-a967-43d7-aa04-dfd40efa81d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 14:18:26 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Trying to clone 0912ae16-bc36-42cb-ba70-6e8401f02f5c from image fed42dad-a967-43d7-aa04-dfd40efa81d3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}]). {{(pid=87011) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 14:18:27 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_zw9p8o9cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 14:18:27 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Image download 20.69 MB at 20.69 MB/s Jul 09 14:18:27 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd086241-93fa-4f3a-ab34-8dce1042a1a8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_zw9p8o9cdevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:27 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_zw9p8o9cdevstack@QuobyteHD Jul 09 14:18:27 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:27 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.082ed88c-1b3f-4d8f-931b-9052bd9e64017hfij0pq.img" returned: 0 in 5.372s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:27 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f77a8c-c56f-4569-88b8-1ffeba567600]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:28 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f Jul 09 14:18:28 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:28 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_zw9p8o9cdevstack@QuobyteHD" returned: 0 in 0.899s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:28 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Temporary image fed42dad-a967-43d7-aa04-dfd40efa81d3 is fetched for user e3678ff9c2054e068965bcc80a7405d6. {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 14:18:28 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afa8add-0651-4974-97c1-5d22b6164168]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_zw9p8o9cdevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:28 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_zw9p8o9cdevstack@QuobyteHD Jul 09 14:18:28 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:28 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f" returned: 0 in 1.027s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:28 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f, size 1024.00 MB, duration 5.37 sec, destination /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.082ed88c-1b3f-4d8f-931b-9052bd9e64017hfij0pq.img {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:18:28 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] Converted 1024.00 MB image at 190.57 MB/s Jul 09 14:18:29 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] 082ed88c-1b3f-4d8f-931b-9052bd9e6401 was raw, converting to qcow2 {{(pid=87011) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 09 14:18:29 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fcffd0-5a91-47e4-81ff-78def7b317e3]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.082ed88c-1b3f-4d8f-931b-9052bd9e64017hfij0pq.img {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:29 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.082ed88c-1b3f-4d8f-931b-9052bd9e64017hfij0pq.img Jul 09 14:18:29 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:29 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_zw9p8o9cdevstack@QuobyteHD" returned: 0 in 0.743s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:29 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.082ed88c-1b3f-4d8f-931b-9052bd9e64017hfij0pq.img" returned: 0 in 0.706s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.082ed88c-1b3f-4d8f-931b-9052bd9e64017hfij0pq.img {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:29 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.082ed88c-1b3f-4d8f-931b-9052bd9e64017hfij0pq.img Jul 09 14:18:29 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:30 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.082ed88c-1b3f-4d8f-931b-9052bd9e64017hfij0pq.img" returned: 1 in 0.715s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.082ed88c-1b3f-4d8f-931b-9052bd9e64017hfij0pq.img' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:18:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.082ed88c-1b3f-4d8f-931b-9052bd9e64017hfij0pq.img /opt/stack/data/cinder/conversion/vol_upload_hlftjs71 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:30 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.082ed88c-1b3f-4d8f-931b-9052bd9e64017hfij0pq.img /opt/stack/data/cinder/conversion/vol_upload_hlftjs71 Jul 09 14:18:30 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:30 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:18:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Flow 'volume_create_manager' (495c9019-fcc0-456a-92de-4092678bc17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:18:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3effde7d-6b90-412c-9819-5c4b68964c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3effde7d-6b90-412c-9819-5c4b68964c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1579160987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280770b1-fcc7-4f39-98a2-63f9fe1e29fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bfe2584aa36c4ae0a4f616ed2b3837be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:18:31Z,use_quota=True,user_id='bc8a647248ea4e6b9fe3d483ccdab5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298cf2d1-6ced-4c04-8ecf-caac4fe26838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298cf2d1-6ced-4c04-8ecf-caac4fe26838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6c99a8-6edf-449b-b82c-812023697ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee6c99a8-6edf-449b-b82c-812023697ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '280770b1-fcc7-4f39-98a2-63f9fe1e29fd', 'volume_name': 'volume-280770b1-fcc7-4f39-98a2-63f9fe1e29fd', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6676f77-1ada-4d55-a687-db6f5627aeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6676f77-1ada-4d55-a687-db6f5627aeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e50190-d70a-44ef-8b2d-579efb197c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:31 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Volume 280770b1-fcc7-4f39-98a2-63f9fe1e29fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-280770b1-fcc7-4f39-98a2-63f9fe1e29fd', 'volume_size': 1} Jul 09 14:18:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:31 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.082ed88c-1b3f-4d8f-931b-9052bd9e64017hfij0pq.img /opt/stack/data/cinder/conversion/vol_upload_hlftjs71" returned: 0 in 0.657s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:31 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] Image conversion details: src /opt/stack/data/cinder/conversion/4d742488-a85c-4bd5-9def-272478df2d4f.temp_image.082ed88c-1b3f-4d8f-931b-9052bd9e64017hfij0pq.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_hlftjs71 {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:18:31 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 09 14:18:31 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[994b9da2-1d21-4a46-bee8-cbc07d6d58f0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hlftjs71 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:31 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hlftjs71 Jul 09 14:18:31 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:31 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_hlftjs71" returned: 0 in 0.697s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.393s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] Uploaded volume to glance image-id: 082ed88c-1b3f-4d8f-931b-9052bd9e6401. {{(pid=87011) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 14:18:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.982s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:33 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=67,cinder:UPDATE=103,cinder:DELETE=8,cinder:INSERT=24 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:18:33 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=94,cinder:SELECT=78,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:18:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] Creating offline snapshot 8fd48548-6392-437b-9694-025855b0124d of volume 2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:18:33 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-0bd3810f-0530-49ed-89dc-88943e49f9b9 tempest-VolumesActionsTest-558150910 None] Copy volume to image completed successfully. Jul 09 14:18:33 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4e5619-6fb4-4d95-be34-7ba88fddffd9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:33 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 Jul 09 14:18:33 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:33 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5" returned: 0 in 0.793s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:33 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d 1G Jul 09 14:18:33 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] Acquiring lock "cinder-4d742488-a85c-4bd5-9def-272478df2d4f-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] Lock "cinder-4d742488-a85c-4bd5-9def-272478df2d4f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] Acquiring lock "cinder-quobyte-4d742488-a85c-4bd5-9def-272478df2d4f" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] Lock "cinder-quobyte-4d742488-a85c-4bd5-9def-272478df2d4f" acquired by "delete_volume" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:34 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c3ae39-ed04-41e1-979a-935c22fa86a8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:34 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f Jul 09 14:18:34 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:34 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d 1G" returned: 0 in 0.788s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:34 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d Jul 09 14:18:34 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:34 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f" returned: 0 in 0.751s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:35 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f Jul 09 14:18:35 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:35 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d" returned: 0 in 0.665s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:35 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d is being set with open permissions: ugo+rw Jul 09 14:18:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:35 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d Jul 09 14:18:35 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:35 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4d742488-a85c-4bd5-9def-272478df2d4f" returned: 0 in 0.648s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] Lock "cinder-quobyte-4d742488-a85c-4bd5-9def-272478df2d4f" released by "delete_volume" :: held 1.439s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:18:35 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] Created reservations ['c5ce3d5c-efb1-49cd-aeaf-b5ffcd18528e', '66c77324-efce-4c72-92a3-9a4bd9e19e09', '67b0bdc4-27a1-44ee-9e85-228ba7d226ee', 'a3bcc584-71c2-4a9b-aa0c-c69d01e48c30'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:18:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:18:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:18:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:35 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:18:35 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:36 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d" returned: 0 in 0.634s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:36 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.info Jul 09 14:18:36 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:36 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.674s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:36 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:18:36 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] Deleted volume successfully. Jul 09 14:18:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ff06c4e0-da11-427e-b59d-c924dc9fd346 tempest-VolumesActionsTest-558150910 None] Lock "cinder-4d742488-a85c-4bd5-9def-272478df2d4f-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:18:36 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.info" returned: 0 in 0.697s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:36 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.info is being set with open permissions: ugo+rw Jul 09 14:18:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:36 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.info Jul 09 14:18:36 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:37 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.info" returned: 0 in 0.691s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.361s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.118s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-950479086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0912ae16-bc36-42cb-ba70-6e8401f02f5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9058cb18077f4f2aa65c49aec22f72f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:18:26Z,use_quota=True,user_id='e3678ff9c2054e068965bcc80a7405d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:18:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Creating volume 0912ae16-bc36-42cb-ba70-6e8401f02f5c {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:18:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:18:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:18:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:18:37 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:18:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:37 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c 1073741824 Jul 09 14:18:37 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:37 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-99e3f19d-ce1f-4a4c-8054-0470f5547f79 tempest-VolumesSnapshotTestJSON-1345456126 None] Create snapshot completed successfully Jul 09 14:18:38 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-8fd48548-6392-437b-9694-025855b0124d-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:38 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-8fd48548-6392-437b-9694-025855b0124d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:38 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-quobyte-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:38 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:38 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-quobyte-8fd48548-6392-437b-9694-025855b0124d" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:38 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-8fd48548-6392-437b-9694-025855b0124d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] Deleting offline snapshot 8fd48548-6392-437b-9694-025855b0124d of volume 2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:18:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] snapshot_file for this snap is: volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:18:38 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb483d8-34fc-4371-9a85-282eddbd8b2d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:38 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d Jul 09 14:18:38 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:38 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c 1073741824" returned: 0 in 0.941s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:38 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c Jul 09 14:18:38 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:39 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:39 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d" returned: 0 in 0.908s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c" returned: 0 in 0.740s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.181s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1579160987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280770b1-fcc7-4f39-98a2-63f9fe1e29fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bfe2584aa36c4ae0a4f616ed2b3837be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:18:31Z,use_quota=True,user_id='bc8a647248ea4e6b9fe3d483ccdab5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Creating volume 280770b1-fcc7-4f39-98a2-63f9fe1e29fd {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:18:39 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-280770b1-fcc7-4f39-98a2-63f9fe1e29fd 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff03961d-a0db-475d-9d08-dcda7ea38eb9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:39 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-280770b1-fcc7-4f39-98a2-63f9fe1e29fd 1073741824 Jul 09 14:18:39 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Attempting download of fed42dad-a967-43d7-aa04-dfd40efa81d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}])) to volume 0912ae16-bc36-42cb-ba70-6e8401f02f5c. {{(pid=87011) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e71b6a6-8828-4187-894b-b0ae4f89fc76]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_ssc6fj1f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:39 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 Jul 09 14:18:39 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:39 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_ssc6fj1f Jul 09 14:18:39 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:40 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5" returned: 0 in 0.959s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:40 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_ssc6fj1f" returned: 0 in 0.882s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_ssc6fj1f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:40 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d Jul 09 14:18:40 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:40 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-280770b1-fcc7-4f39-98a2-63f9fe1e29fd 1073741824" returned: 0 in 1.104s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:40 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_ssc6fj1f Jul 09 14:18:40 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-280770b1-fcc7-4f39-98a2-63f9fe1e29fd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:40 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-280770b1-fcc7-4f39-98a2-63f9fe1e29fd Jul 09 14:18:40 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:41 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d" returned: 0 in 0.862s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:41 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d Jul 09 14:18:41 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:41 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_ssc6fj1f" returned: 1 in 0.889s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_ssc6fj1f' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22b2453-5fc4-44fc-bfba-f02295709d3f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_zw9p8o9cdevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:41 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-280770b1-fcc7-4f39-98a2-63f9fe1e29fd" returned: 0 in 0.870s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] <== create_volume: return (2032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:18:41 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_zw9p8o9cdevstack@QuobyteHD Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:41 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e50190-d70a-44ef-8b2d-579efb197c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-280770b1-fcc7-4f39-98a2-63f9fe1e29fd', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f82ce0-34da-47da-bbf0-758116c5df27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:41 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Volume volume-280770b1-fcc7-4f39-98a2-63f9fe1e29fd (280770b1-fcc7-4f39-98a2-63f9fe1e29fd): created successfully Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f82ce0-34da-47da-bbf0-758116c5df27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Flow 'volume_create_manager' (495c9019-fcc0-456a-92de-4092678bc17c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:18:41 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-01ec1be8-b294-4930-8a10-2f856c678d00 tempest-VolumesTestJSON-609930983 None] Created volume successfully. Jul 09 14:18:41 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5.8fd48548-6392-437b-9694-025855b0124d" returned: 0 in 0.727s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-8fd48548-6392-437b-9694-025855b0124d" released by "_delete_snapshot" :: held 3.600s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5" released by "delete_snapshot" :: held 3.628s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] Created reservations ['966004b7-b99c-46dd-8156-0c40c60f9c7b', 'f6f1dae3-f16a-4a93-91cc-4c89221d7065', 'ce5aa88a-9b22-454d-b397-27a9f84c35e8', '0d835b7e-2e2b-4f0f-8dc8-4e409f436356'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:18:41 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] Delete snapshot completed successfully. Jul 09 14:18:41 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_zw9p8o9cdevstack@QuobyteHD" returned: 0 in 0.862s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] fed42dad-a967-43d7-aa04-dfd40efa81d3 was qcow2, converting to raw {{(pid=87011) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 14:18:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_zw9p8o9cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-343588c6-b8ce-43ea-a93d-e14803e6d2d7 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-8fd48548-6392-437b-9694-025855b0124d-delete_snapshot" released by "delete_snapshot" :: held 3.868s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:18:42 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_zw9p8o9cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c Jul 09 14:18:42 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Flow 'volume_create_manager' (25ec2f77-bbe9-47d0-9e8d-1cadf76aad7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648e52b7-e0f7-4137-b0bd-63483e65e581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648e52b7-e0f7-4137-b0bd-63483e65e581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1615313402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e2dd2f-b162-4bd7-b81e-4f6e458c86c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bfe2584aa36c4ae0a4f616ed2b3837be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:18:42Z,use_quota=True,user_id='bc8a647248ea4e6b9fe3d483ccdab5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e66037-14d4-43bb-8a85-f81824f6e2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e66037-14d4-43bb-8a85-f81824f6e2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622786e6-6bb6-4994-9f7c-bc45da6b2f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622786e6-6bb6-4994-9f7c-bc45da6b2f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e2dd2f-b162-4bd7-b81e-4f6e458c86c7', 'volume_name': 'volume-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46bc670-317e-4006-b115-2190752484c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46bc670-317e-4006-b115-2190752484c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00540f20-994d-4d08-bce1-518e08546f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:42 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Volume 01e2dd2f-b162-4bd7-b81e-4f6e458c86c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7', 'volume_size': 1} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1615313402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e2dd2f-b162-4bd7-b81e-4f6e458c86c7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bfe2584aa36c4ae0a4f616ed2b3837be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:18:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:18:42Z,use_quota=True,user_id='bc8a647248ea4e6b9fe3d483ccdab5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Creating volume 01e2dd2f-b162-4bd7-b81e-4f6e458c86c7 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:18:42 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:18:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:42 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7 1073741824 Jul 09 14:18:42 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:43 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:18:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Flow 'volume_create_manager' (e44924e5-744f-451d-b406-4f0615da2f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:18:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff3ed037-89c1-4044-8896-e93408d74bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff3ed037-89c1-4044-8896-e93408d74bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-273525384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33499df0-0283-46ca-9ad5-cc7c857f9c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8449f98c569944df9b37db8ac7f2b56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:18:43Z,use_quota=True,user_id='f8e98e41e8c849899537910621e35e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4c94e2-7282-47ae-9f1f-5aee0ed1e1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d4c94e2-7282-47ae-9f1f-5aee0ed1e1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b401ed-eb19-484d-a11e-5bd0707a02b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b401ed-eb19-484d-a11e-5bd0707a02b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33499df0-0283-46ca-9ad5-cc7c857f9c23', 'volume_name': 'volume-33499df0-0283-46ca-9ad5-cc7c857f9c23', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adeda56e-9764-44a9-9883-bf79b9f0e4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adeda56e-9764-44a9-9883-bf79b9f0e4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82d1153-6d4a-41e5-aae3-0d08de180848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:43 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Volume 33499df0-0283-46ca-9ad5-cc7c857f9c23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33499df0-0283-46ca-9ad5-cc7c857f9c23', 'volume_size': 1} Jul 09 14:18:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:43 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7 1073741824" returned: 0 in 1.245s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:43 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7 Jul 09 14:18:43 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:44 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:44 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7" returned: 0 in 0.767s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] <== create_volume: return (2061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.182s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-273525384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33499df0-0283-46ca-9ad5-cc7c857f9c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8449f98c569944df9b37db8ac7f2b56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:18:43Z,use_quota=True,user_id='f8e98e41e8c849899537910621e35e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Creating volume 33499df0-0283-46ca-9ad5-cc7c857f9c23 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:18:44 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_zw9p8o9cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c" returned: 0 in 2.414s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_zw9p8o9cdevstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:18:44 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Converted 112.00 MB image at 46.37 MB/s Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:44 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 1073741824 Jul 09 14:18:44 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00540f20-994d-4d08-bce1-518e08546f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478fe512-6cb0-4b26-b7cb-cf35722352a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:44 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c 1G Jul 09 14:18:44 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:44 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Volume volume-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7 (01e2dd2f-b162-4bd7-b81e-4f6e458c86c7): created successfully Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478fe512-6cb0-4b26-b7cb-cf35722352a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Flow 'volume_create_manager' (25ec2f77-bbe9-47d0-9e8d-1cadf76aad7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:18:44 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-10802426-cff4-450f-b4d1-5e88060b2539 tempest-VolumesTestJSON-609930983 None] Created volume successfully. Jul 09 14:18:45 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c 1G" returned: 0 in 0.780s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:45 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb83a97c-2fda-4243-b70b-ae09c344be00]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:45 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 1073741824" returned: 0 in 0.886s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:45 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c Jul 09 14:18:45 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:45 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 Jul 09 14:18:45 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:46 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23" returned: 0 in 0.769s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Flow 'volume_create_manager' (b8259709-d0eb-4f5f-bc50-73403a9197b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfdeea09-5b5f-4709-bf0a-e7a9db4c64de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:46 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c" returned: 0 in 0.920s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfdeea09-5b5f-4709-bf0a-e7a9db4c64de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1876014468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bfe2584aa36c4ae0a4f616ed2b3837be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:18:46Z,use_quota=True,user_id='bc8a647248ea4e6b9fe3d483ccdab5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aebdf38-7b9f-4388-9cd6-c24a9be1bea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aebdf38-7b9f-4388-9cd6-c24a9be1bea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59be9967-93e3-4089-80f9-64450d129547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59be9967-93e3-4089-80f9-64450d129547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b', 'volume_name': 'volume-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58b02d1-2f2d-4b76-a91e-3dca20c95ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58b02d1-2f2d-4b76-a91e-3dca20c95ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832493a0-182a-4545-8123-91a448546122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:46 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Volume fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b', 'volume_size': 1} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1876014468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bfe2584aa36c4ae0a4f616ed2b3837be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:18:46Z,use_quota=True,user_id='bc8a647248ea4e6b9fe3d483ccdab5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Creating volume fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:18:46 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82d1153-6d4a-41e5-aae3-0d08de180848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33499df0-0283-46ca-9ad5-cc7c857f9c23', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfc343a-3201-473d-bb62-c82d61c6a59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:46 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b 1073741824 Jul 09 14:18:46 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:46 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Volume volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 (33499df0-0283-46ca-9ad5-cc7c857f9c23): created successfully Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfc343a-3201-473d-bb62-c82d61c6a59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Flow 'volume_create_manager' (e44924e5-744f-451d-b406-4f0615da2f47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:18:46 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-21a45213-ab4d-4c0a-bf46-2ea47b9c4bb9 tempest-VolumesSnapshotTestJSON-1345456126 None] Created volume successfully. Jul 09 14:18:46 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c Jul 09 14:18:46 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:46 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c" returned: 1 in 0.816s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Downloaded image fed42dad-a967-43d7-aa04-dfd40efa81d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}])) to volume 0912ae16-bc36-42cb-ba70-6e8401f02f5c successfully. {{(pid=87011) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Temporary image fed42dad-a967-43d7-aa04-dfd40efa81d3 for user e3678ff9c2054e068965bcc80a7405d6 is deleted. {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 14:18:46 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Marking volume 0912ae16-bc36-42cb-ba70-6e8401f02f5c as bootable. {{(pid=87011) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 14:18:47 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Copying metadata from image fed42dad-a967-43d7-aa04-dfd40efa81d3 to 0912ae16-bc36-42cb-ba70-6e8401f02f5c. {{(pid=87011) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 14:18:47 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Creating volume glance metadata for volume 0912ae16-bc36-42cb-ba70-6e8401f02f5c backed by image fed42dad-a967-43d7-aa04-dfd40efa81d3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87011) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 14:18:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f29893-9182-4040-a6b5-5c2b527981a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c', 'volume_size': 1, 'image_id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c87c562978df4c18bad93b074708151d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'created_at': datetime.datetime(2026, 7, 9, 12, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fed42dad-a967-43d7-aa04-dfd40efa81d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05348151-5165-440b-8e10-242558cf7159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:47 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Volume volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c (0912ae16-bc36-42cb-ba70-6e8401f02f5c): created successfully Jul 09 14:18:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05348151-5165-440b-8e10-242558cf7159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Flow 'volume_create_manager' (d6dccf38-a5fc-49ce-8cf9-bc49a1cb3c42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:18:47 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-970abff8-262b-4015-93a1-e3dbd607975d tempest-VolumesExtendTest-1321307395 None] Created volume successfully. Jul 09 14:18:47 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b 1073741824" returned: 0 in 0.958s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:47 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b Jul 09 14:18:47 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:48 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b" returned: 0 in 0.864s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:18:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.543s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] Creating offline snapshot 91e2a63d-d2bd-4ff2-8794-df4776a95655 of volume 33499df0-0283-46ca-9ad5-cc7c857f9c23 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:18:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832493a0-182a-4545-8123-91a448546122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52bfb01-ca84-4e5f-9576-dcf9a8ea430d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:48 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[474bc3e9-e16d-4f9a-8293-85b51565292c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:48 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Volume volume-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b (fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b): created successfully Jul 09 14:18:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52bfb01-ca84-4e5f-9576-dcf9a8ea430d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Flow 'volume_create_manager' (b8259709-d0eb-4f5f-bc50-73403a9197b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:18:48 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-7f70936d-6b45-4d33-a9b2-29237a798aa0 tempest-VolumesTestJSON-609930983 None] Created volume successfully. Jul 09 14:18:48 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 Jul 09 14:18:48 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7e3260a6-7940-4b12-b234-01e74b23bdd7 tempest-VolumesExtendTest-1321307395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:48 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23" returned: 0 in 0.819s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:49 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655 1G Jul 09 14:18:49 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:49 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655 1G" returned: 0 in 0.969s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:49 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655 Jul 09 14:18:49 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:50 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] Acquiring lock "cinder-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:50 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] Lock "cinder-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:50 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] Acquiring lock "cinder-quobyte-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:50 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] Lock "cinder-quobyte-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b" acquired by "delete_volume" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:50 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d82101-6771-498e-9e7e-5127e321aad8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:50 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b Jul 09 14:18:50 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:50 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655" returned: 0 in 0.800s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:50 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655 is being set with open permissions: ugo+rw Jul 09 14:18:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:50 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655 Jul 09 14:18:50 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:51 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b" returned: 0 in 0.800s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:51 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b Jul 09 14:18:51 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:51 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655" returned: 0 in 0.652s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:51 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.info Jul 09 14:18:51 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:51 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b" returned: 0 in 0.668s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] Lock "cinder-quobyte-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b" released by "delete_volume" :: held 1.521s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:18:51 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] Created reservations ['a971b0a9-e84d-47b2-8242-8652796586a4', '15676abb-97c5-4e9e-8b47-65b944d659d4', '22a0c83c-12e1-46cb-aef8-a59a1faa1683', 'dafcb58c-bf4c-4eb9-b353-5da3914d462d'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:18:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:18:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:18:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:52 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:18:52 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:52 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.info" returned: 0 in 0.744s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:52 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.info is being set with open permissions: ugo+rw Jul 09 14:18:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:52 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.info Jul 09 14:18:52 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] Acquiring lock "cinder-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] Lock "cinder-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] Acquiring lock "cinder-quobyte-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] Lock "cinder-quobyte-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:52 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0d4b04-b005-4d10-8f26-e16ed801b726]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:52 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7 Jul 09 14:18:52 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:52 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.865s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:52 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:18:52 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] Deleted volume successfully. Jul 09 14:18:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f7988475-22c4-4ce9-a684-857e7cc79af5 tempest-VolumesTestJSON-609930983 None] Lock "cinder-fdfbc9a3-87f4-48bc-83cd-9ed43543cf5b-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:18:53 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.info" returned: 0 in 0.809s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.928s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7e3260a6-7940-4b12-b234-01e74b23bdd7 tempest-VolumesExtendTest-1321307395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.648s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:53 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d8feb97e-3fe1-4863-9d3c-af1ce93e8a55 tempest-VolumesSnapshotTestJSON-1345456126 None] Create snapshot completed successfully Jul 09 14:18:53 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6a7c3a-c287-4dd9-b452-a620c16bac9f]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e3260a6-7940-4b12-b234-01e74b23bdd7 tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:53 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c Jul 09 14:18:53 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:53 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7" returned: 0 in 0.936s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:53 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7 Jul 09 14:18:53 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:54 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e3260a6-7940-4b12-b234-01e74b23bdd7 tempest-VolumesExtendTest-1321307395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c" returned: 0 in 1.141s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e3260a6-7940-4b12-b234-01e74b23bdd7 tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:54 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c Jul 09 14:18:54 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:54 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7" returned: 0 in 0.829s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] Lock "cinder-quobyte-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7" released by "delete_volume" :: held 1.847s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Flow 'volume_create_manager' (0503241c-27d6-493d-97ca-7ed1bb4613e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035232cf-5e53-43ff-a530-a27bf50b0d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035232cf-5e53-43ff-a530-a27bf50b0d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1025376144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d237a065-c3e3-4ede-b12a-416337f6f4bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8449f98c569944df9b37db8ac7f2b56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:18:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=91e2a63d-d2bd-4ff2-8794-df4776a95655,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:18:54Z,use_quota=True,user_id='f8e98e41e8c849899537910621e35e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc83d7d7-6395-4577-a1b6-c7945b31a364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc83d7d7-6395-4577-a1b6-c7945b31a364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc3512a-28b2-4ad0-9e42-f32a5e3c7b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc3512a-28b2-4ad0-9e42-f32a5e3c7b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd237a065-c3e3-4ede-b12a-416337f6f4bd', 'volume_name': 'volume-d237a065-c3e3-4ede-b12a-416337f6f4bd', 'volume_size': 2, 'snapshot_id': '91e2a63d-d2bd-4ff2-8794-df4776a95655'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b181413-6eef-42f6-b350-d6d29cdc5bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b181413-6eef-42f6-b350-d6d29cdc5bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe4aedc-6737-47c7-941d-ddc3fd2a870d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:18:54 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Volume d237a065-c3e3-4ede-b12a-416337f6f4bd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d237a065-c3e3-4ede-b12a-416337f6f4bd', 'volume_size': 2, 'snapshot_id': '91e2a63d-d2bd-4ff2-8794-df4776a95655'} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] Created reservations ['0ccc47a7-764a-488e-8419-480d8aa483be', 'c585f08c-ea02-43d1-b79b-384cf218d35a', '9abfddc0-cf5f-4892-bd75-d19f7d0dfc2a', 'ad620ff0-5723-4d2c-ad10-0f579753c5b7'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:54 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:18:54 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:55 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e3260a6-7940-4b12-b234-01e74b23bdd7 tempest-VolumesExtendTest-1321307395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c" returned: 1 in 0.937s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e3260a6-7940-4b12-b234-01e74b23bdd7 tempest-VolumesExtendTest-1321307395 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e3260a6-7940-4b12-b234-01e74b23bdd7 tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c 2G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e3260a6-7940-4b12-b234-01e74b23bdd7 tempest-VolumesExtendTest-1321307395 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c 2G" returned: 0 in 0.067s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7e3260a6-7940-4b12-b234-01e74b23bdd7 tempest-VolumesExtendTest-1321307395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.207s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.562s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-quobyte-91e2a63d-d2bd-4ff2-8794-df4776a95655-d237a065-c3e3-4ede-b12a-416337f6f4bd" by "_create_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-91e2a63d-d2bd-4ff2-8794-df4776a95655-d237a065-c3e3-4ede-b12a-416337f6f4bd" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Creating volume d237a065-c3e3-4ede-b12a-416337f6f4bd from snapshot 91e2a63d-d2bd-4ff2-8794-df4776a95655 {{(pid=87011) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-quobyte-d237a065-c3e3-4ede-b12a-416337f6f4bd" by "_copy_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-d237a065-c3e3-4ede-b12a-416337f6f4bd" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] snapshot: 91e2a63d-d2bd-4ff2-8794-df4776a95655, volume: d237a065-c3e3-4ede-b12a-416337f6f4bd, {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 14:18:55 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-7e3260a6-7940-4b12-b234-01e74b23bdd7 tempest-VolumesExtendTest-1321307395 None] Extend volume completed successfully. Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f00c9c2-2f66-4c81-8ea0-4755ebc0a31a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:55 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.742s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:18:55 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] Deleted volume successfully. Jul 09 14:18:55 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655 Jul 09 14:18:55 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-484f42d0-4b33-494c-a678-593c8b57f5e6 tempest-VolumesTestJSON-609930983 None] Lock "cinder-01e2dd2f-b162-4bd7-b81e-4f6e458c86c7-delete_volume" released by "delete_volume" :: held 3.000s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] Acquiring lock "cinder-280770b1-fcc7-4f39-98a2-63f9fe1e29fd-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] Lock "cinder-280770b1-fcc7-4f39-98a2-63f9fe1e29fd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] Acquiring lock "cinder-quobyte-280770b1-fcc7-4f39-98a2-63f9fe1e29fd" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] Lock "cinder-quobyte-280770b1-fcc7-4f39-98a2-63f9fe1e29fd" acquired by "delete_volume" :: waited 0.028s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:56 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[45884cdd-0abe-48aa-b394-b7da7e6205b0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-280770b1-fcc7-4f39-98a2-63f9fe1e29fd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:56 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-280770b1-fcc7-4f39-98a2-63f9fe1e29fd Jul 09 14:18:56 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] Acquiring lock "cinder-0912ae16-bc36-42cb-ba70-6e8401f02f5c-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] Lock "cinder-0912ae16-bc36-42cb-ba70-6e8401f02f5c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] Acquiring lock "cinder-quobyte-0912ae16-bc36-42cb-ba70-6e8401f02f5c" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:18:56 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655" returned: 0 in 0.990s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33499df0-0283-46ca-9ad5-cc7c857f9c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:18:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 14:18:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Creating direct copy from snapshot {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 14:18:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] Lock "cinder-quobyte-0912ae16-bc36-42cb-ba70-6e8401f02f5c" acquired by "delete_volume" :: waited 0.029s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:18:56 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce5f06e-916a-4e3a-b691-a51adcdb4b44]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:56 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5951037d-e413-4f18-a592-515f570f7a18]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:18:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:56 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 Jul 09 14:18:56 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:56 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c Jul 09 14:18:56 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:56 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-280770b1-fcc7-4f39-98a2-63f9fe1e29fd" returned: 0 in 0.921s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-280770b1-fcc7-4f39-98a2-63f9fe1e29fd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:56 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-280770b1-fcc7-4f39-98a2-63f9fe1e29fd Jul 09 14:18:56 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:57 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23" returned: 0 in 0.939s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:57 devstack cinder-volume[87011]: DEBUG cinder.utils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Path /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237a065-c3e3-4ede-b12a-416337f6f4bd not found in is_blk_device check {{(pid=87011) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 14:18:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237a065-c3e3-4ede-b12a-416337f6f4bd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:57 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237a065-c3e3-4ede-b12a-416337f6f4bd Jul 09 14:18:57 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:57 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c" returned: 0 in 1.050s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:57 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c Jul 09 14:18:57 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:57 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-280770b1-fcc7-4f39-98a2-63f9fe1e29fd" returned: 0 in 0.944s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] Lock "cinder-quobyte-280770b1-fcc7-4f39-98a2-63f9fe1e29fd" released by "delete_volume" :: held 1.929s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:18:57 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] Created reservations ['b6f968c3-a14e-4598-ba6c-6a42f8c257bf', '464b00c7-f344-4719-a20e-aae0c3a8289e', '4be1c87f-ff01-484a-9cd9-1462e3628b1d', 'fdfe30dc-288f-4349-8502-fe7b91be36a3'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:18:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:18:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:18:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:18:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:18:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:18:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:58 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:18:58 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:58 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c" returned: 1 in 1.072s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:18:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:18:58 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c Jul 09 14:18:58 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:18:59 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Jul 09 14:18:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.185s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:18:59 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:18:59 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] Deleted volume successfully. Jul 09 14:18:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-771beaf4-d1b2-4924-8ee0-9fe6db950898 tempest-VolumesTestJSON-609930983 None] Lock "cinder-280770b1-fcc7-4f39-98a2-63f9fe1e29fd-delete_volume" released by "delete_volume" :: held 3.454s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:00 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0912ae16-bc36-42cb-ba70-6e8401f02f5c" returned: 0 in 2.140s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:00 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] Lock "cinder-quobyte-0912ae16-bc36-42cb-ba70-6e8401f02f5c" released by "delete_volume" :: held 4.398s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:00 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] Created reservations ['68ed9270-925a-484e-94aa-8a6f14f59a03', '40db627c-98a9-437d-b235-091918d13e6d', '67395107-fdfa-48d4-8b31-0756ee980c3b', 'a623f663-cb3b-4188-a90c-082c8da6677e'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:19:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:01 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:01 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:01 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:19:01 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:02 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:19:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Flow 'volume_create_manager' (6853b7e9-ef11-48f9-aa80-70869da54891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:19:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dace8b4d-e577-4b0d-b9f9-0103ac18014d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dace8b4d-e577-4b0d-b9f9-0103ac18014d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-311277989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5938c4-7ba9-4870-a3d2-24b2855e00bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9058cb18077f4f2aa65c49aec22f72f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:19:03Z,use_quota=True,user_id='e3678ff9c2054e068965bcc80a7405d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:02 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe088afe-a046-4022-9b3d-0570c3a9e72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe088afe-a046-4022-9b3d-0570c3a9e72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545ceb17-9e8f-4055-bd65-fece0313b48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (545ceb17-9e8f-4055-bd65-fece0313b48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff5938c4-7ba9-4870-a3d2-24b2855e00bf', 'volume_name': 'volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d3ba5e-9255-4e8f-86c0-7974dec6fd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d3ba5e-9255-4e8f-86c0-7974dec6fd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4011d9d5-df48-4815-9830-8a496ebb4239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:03 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Volume ff5938c4-7ba9-4870-a3d2-24b2855e00bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf', 'volume_size': 1} Jul 09 14:19:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.919s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:03 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:19:03 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] Deleted volume successfully. Jul 09 14:19:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-49df3da2-7b83-42f5-b986-82422d50b896 tempest-VolumesExtendTest-1321307395 None] Lock "cinder-0912ae16-bc36-42cb-ba70-6e8401f02f5c-delete_volume" released by "delete_volume" :: held 6.754s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:04 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237a065-c3e3-4ede-b12a-416337f6f4bd" returned: 0 in 7.272s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:04 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ca2733-2bdf-4d23-bd67-d3bcf860f199]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:04 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 Jul 09 14:19:04 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:05 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23" returned: 0 in 1.105s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:05 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23, size 1024.00 MB, duration 7.28 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237a065-c3e3-4ede-b12a-416337f6f4bd {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:19:05 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Converted 1024.00 MB image at 140.73 MB/s Jul 09 14:19:05 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237a065-c3e3-4ede-b12a-416337f6f4bd is being set with open permissions: ugo+rw Jul 09 14:19:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237a065-c3e3-4ede-b12a-416337f6f4bd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:05 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237a065-c3e3-4ede-b12a-416337f6f4bd Jul 09 14:19:05 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:06 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237a065-c3e3-4ede-b12a-416337f6f4bd" returned: 0 in 0.677s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:06 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-d237a065-c3e3-4ede-b12a-416337f6f4bd" released by "_copy_volume_from_snapshot" :: held 11.161s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:06 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-91e2a63d-d2bd-4ff2-8794-df4776a95655-d237a065-c3e3-4ede-b12a-416337f6f4bd" released by "_create_volume_from_snapshot" :: held 11.210s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.238s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.485s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:06 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-311277989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5938c4-7ba9-4870-a3d2-24b2855e00bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9058cb18077f4f2aa65c49aec22f72f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:19:03Z,use_quota=True,user_id='e3678ff9c2054e068965bcc80a7405d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:19:06 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Creating volume ff5938c4-7ba9-4870-a3d2-24b2855e00bf {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:19:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:06 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:06 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:06 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:19:06 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:19:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:06 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf 1073741824 Jul 09 14:19:06 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe4aedc-6737-47c7-941d-ddc3fd2a870d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d237a065-c3e3-4ede-b12a-416337f6f4bd', 'volume_size': 2, 'snapshot_id': '91e2a63d-d2bd-4ff2-8794-df4776a95655'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20297217-3c16-4a52-ae86-f878a6a9e33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:06 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Volume volume-d237a065-c3e3-4ede-b12a-416337f6f4bd (d237a065-c3e3-4ede-b12a-416337f6f4bd): created successfully Jul 09 14:19:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20297217-3c16-4a52-ae86-f878a6a9e33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:06 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Flow 'volume_create_manager' (0503241c-27d6-493d-97ca-7ed1bb4613e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:19:06 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-2e9298dd-9b86-49fc-8a34-df5e4873c578 tempest-VolumesSnapshotTestJSON-1345456126 None] Created volume successfully. Jul 09 14:19:07 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-17fbd9ca-6774-4b5f-b355-5d8f798afbec tempest-GroupSnapshotsV319Test-1416005546 None] Group tempest-GroupSnapshotsV319Test-Group-1987806867: creating Jul 09 14:19:07 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-17fbd9ca-6774-4b5f-b355-5d8f798afbec tempest-GroupSnapshotsV319Test-1416005546 None] Group tempest-GroupSnapshotsV319Test-Group-1987806867: created successfully Jul 09 14:19:07 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-17fbd9ca-6774-4b5f-b355-5d8f798afbec tempest-GroupSnapshotsV319Test-1416005546 None] Create group completed successfully. Jul 09 14:19:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-d237a065-c3e3-4ede-b12a-416337f6f4bd-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-d237a065-c3e3-4ede-b12a-416337f6f4bd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-quobyte-d237a065-c3e3-4ede-b12a-416337f6f4bd" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-d237a065-c3e3-4ede-b12a-416337f6f4bd" acquired by "delete_volume" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:07 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56553f0-5bf3-4a06-9028-c648afeb1f01]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237a065-c3e3-4ede-b12a-416337f6f4bd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:07 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237a065-c3e3-4ede-b12a-416337f6f4bd Jul 09 14:19:07 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:07 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf 1073741824" returned: 0 in 1.069s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:07 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf Jul 09 14:19:07 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:08 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237a065-c3e3-4ede-b12a-416337f6f4bd" returned: 0 in 1.047s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237a065-c3e3-4ede-b12a-416337f6f4bd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:08 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf" returned: 0 in 0.751s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:19:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:08 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237a065-c3e3-4ede-b12a-416337f6f4bd Jul 09 14:19:08 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4011d9d5-df48-4815-9830-8a496ebb4239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756ff106-53da-40c6-a74f-c65bdfe76f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:08 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Volume volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf (ff5938c4-7ba9-4870-a3d2-24b2855e00bf): created successfully Jul 09 14:19:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756ff106-53da-40c6-a74f-c65bdfe76f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Flow 'volume_create_manager' (6853b7e9-ef11-48f9-aa80-70869da54891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:19:08 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-e4e5cd4d-84ec-412b-b0f0-4a655db4bbc0 tempest-VolumesExtendTest-1321307395 None] Created volume successfully. Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Flow 'volume_create_manager' (a3a71fc8-a236-4506-816c-b48251d19164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956611ee-27f3-4bef-91a6-5df7eb9f12a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956611ee-27f3-4bef-91a6-5df7eb9f12a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1064098658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=adc08ca3-4454-44d3-95c5-602f3219108d,host='devstack@QuobyteHD#QuobyteHD',id=2ffc2441-c820-40d6-bf17-c3f455310bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42e60495162495da4cfd0271d18ed98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:19:09Z,use_quota=True,user_id='e1b3df3cf721414a88a89db1019f8e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0541adc-4128-42a7-92ec-61c1f3d26ed3),volume_type_id=b0541adc-4128-42a7-92ec-61c1f3d26ed3)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7b08d8-7d9c-4fec-81c4-6a044a6a4176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7b08d8-7d9c-4fec-81c4-6a044a6a4176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a5c46d-e914-463f-a95c-e3b992e23fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a5c46d-e914-463f-a95c-e3b992e23fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ffc2441-c820-40d6-bf17-c3f455310bc8', 'volume_name': 'volume-2ffc2441-c820-40d6-bf17-c3f455310bc8', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91475c3-e6e0-4598-91fd-2c267b4dd501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91475c3-e6e0-4598-91fd-2c267b4dd501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e89737-0c70-4c0a-b306-83458d59222a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:09 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Volume 2ffc2441-c820-40d6-bf17-c3f455310bc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ffc2441-c820-40d6-bf17-c3f455310bc8', 'volume_size': 1} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=adc08ca3-4454-44d3-95c5-602f3219108d,created_at=2026-07-09T12:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1064098658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=adc08ca3-4454-44d3-95c5-602f3219108d,host='devstack@QuobyteHD#QuobyteHD',id=2ffc2441-c820-40d6-bf17-c3f455310bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42e60495162495da4cfd0271d18ed98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:19:09Z,use_quota=True,user_id='e1b3df3cf721414a88a89db1019f8e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0541adc-4128-42a7-92ec-61c1f3d26ed3),volume_type_id=b0541adc-4128-42a7-92ec-61c1f3d26ed3)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Creating volume 2ffc2441-c820-40d6-bf17-c3f455310bc8 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:19:09 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:09 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237a065-c3e3-4ede-b12a-416337f6f4bd" returned: 0 in 0.764s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:09 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8 1073741824 Jul 09 14:19:09 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-d237a065-c3e3-4ede-b12a-416337f6f4bd" released by "delete_volume" :: held 1.857s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] Created reservations ['ccd9de2a-faeb-4d35-8079-711c91387f79', 'b08fe1f0-f4a9-44d9-b42b-bc66f82b6f0d', '0756a1dd-ecd8-42fa-9e96-acca0e2a0762', '16d86c5a-610b-443b-b9cc-81b4a951bbc3'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:09 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:19:09 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-91e2a63d-d2bd-4ff2-8794-df4776a95655-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-91e2a63d-d2bd-4ff2-8794-df4776a95655-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-quobyte-33499df0-0283-46ca-9ad5-cc7c857f9c23" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-33499df0-0283-46ca-9ad5-cc7c857f9c23" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-quobyte-91e2a63d-d2bd-4ff2-8794-df4776a95655" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-91e2a63d-d2bd-4ff2-8794-df4776a95655" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] Deleting offline snapshot 91e2a63d-d2bd-4ff2-8794-df4776a95655 of volume 33499df0-0283-46ca-9ad5-cc7c857f9c23 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] snapshot_file for this snap is: volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9eb60a-4130-4e01-aebf-ee13deba54ea]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:09 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655 Jul 09 14:19:09 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:10 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.915s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:10 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:19:10 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] Deleted volume successfully. Jul 09 14:19:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fb07cd75-6c7a-48dd-93a6-599f2586358f tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-d237a065-c3e3-4ede-b12a-416337f6f4bd-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:10 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8 1073741824" returned: 0 in 1.196s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:10 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8 Jul 09 14:19:10 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:10 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655" returned: 0 in 0.931s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33499df0-0283-46ca-9ad5-cc7c857f9c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:19:10 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4d2dd9-968b-46d3-811c-c4223b86bddc]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:10 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 Jul 09 14:19:10 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:11 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8" returned: 0 in 0.707s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:11 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:19:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.443s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:11 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] Creating offline snapshot 5419e512-04fa-43fa-ad0f-087042958cad of volume ff5938c4-7ba9-4870-a3d2-24b2855e00bf {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:19:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e89737-0c70-4c0a-b306-83458d59222a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ffc2441-c820-40d6-bf17-c3f455310bc8', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb1645d-981b-441b-8740-0517b6684932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:11 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7af808-ff30-46cc-88cc-52f5c4590930]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:11 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Volume volume-2ffc2441-c820-40d6-bf17-c3f455310bc8 (2ffc2441-c820-40d6-bf17-c3f455310bc8): created successfully Jul 09 14:19:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb1645d-981b-441b-8740-0517b6684932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Flow 'volume_create_manager' (a3a71fc8-a236-4506-816c-b48251d19164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:19:11 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-67a4d3b6-0562-4118-ba6d-e7e462aed902 tempest-GroupSnapshotsV319Test-1416005546 None] Created volume successfully. Jul 09 14:19:11 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf Jul 09 14:19:11 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:11 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23" returned: 0 in 1.084s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:11 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] GroupSnapshot ce66fcc4-2b67-4aca-8c76-a7c46abbad3f: creating. Jul 09 14:19:11 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655 Jul 09 14:19:11 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] Group snapshot ce66fcc4-2b67-4aca-8c76-a7c46abbad3f: creating. {{(pid=87011) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 14:19:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:12 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf" returned: 0 in 1.049s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:12 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad 1G Jul 09 14:19:12 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:19:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:12 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:19:12 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:12 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655" returned: 0 in 0.869s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:12 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655 Jul 09 14:19:12 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:13 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad 1G" returned: 0 in 0.960s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:13 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad Jul 09 14:19:13 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:13 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.823s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:19:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:19:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:19:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:19:13 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23.91e2a63d-d2bd-4ff2-8794-df4776a95655" returned: 0 in 0.820s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-91e2a63d-d2bd-4ff2-8794-df4776a95655" released by "_delete_snapshot" :: held 3.865s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-33499df0-0283-46ca-9ad5-cc7c857f9c23" released by "delete_snapshot" :: held 3.901s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:13 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] Created reservations ['f2b96f1b-d7f4-4918-b3bc-ca2d1d0417de', 'de479ef7-9f69-426b-8ccc-23d349d368be', '4a0fd30f-700f-45f6-b15a-3f71ec13f731', '4b8fc56a-20ac-4747-9d37-bc3b51d098cd'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:19:13 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] Delete snapshot completed successfully. Jul 09 14:19:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-383fde50-2b1e-46ff-8bca-0d28c7df1fcd tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-91e2a63d-d2bd-4ff2-8794-df4776a95655-delete_snapshot" released by "delete_snapshot" :: held 4.094s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:13 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad" returned: 0 in 0.726s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:13 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad is being set with open permissions: ugo+rw Jul 09 14:19:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:13 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad Jul 09 14:19:13 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-33499df0-0283-46ca-9ad5-cc7c857f9c23-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-33499df0-0283-46ca-9ad5-cc7c857f9c23-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-quobyte-33499df0-0283-46ca-9ad5-cc7c857f9c23" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-33499df0-0283-46ca-9ad5-cc7c857f9c23" acquired by "delete_volume" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:14 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6898a0e-08cf-44ec-96cb-95cde1d39ff8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:14 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 Jul 09 14:19:14 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:14 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad" returned: 0 in 0.749s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:14 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.info Jul 09 14:19:14 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:15 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23" returned: 0 in 0.884s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:15 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23 Jul 09 14:19:15 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:15 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.info" returned: 0 in 0.736s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:15 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.info is being set with open permissions: ugo+rw Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:15 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.info Jul 09 14:19:15 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Flow 'volume_create_manager' (51331d57-9fa1-4805-b625-118594bc5ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d3b711-778a-4dc8-a3f9-d18832850a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d3b711-778a-4dc8-a3f9-d18832850a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-548616337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93fe0b7c-70b3-4f86-ba52-8018ead92b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8d4af57a1044bc8da3d66b8d76aa46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:19:15Z,use_quota=True,user_id='bab14b8e1a98439ab4ecb7ad584044b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccf98c1-50fb-4a17-ab56-b1b0b1ef5771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ccf98c1-50fb-4a17-ab56-b1b0b1ef5771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4a5d40-1403-4c1f-8d3d-10ec4662d98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4a5d40-1403-4c1f-8d3d-10ec4662d98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93fe0b7c-70b3-4f86-ba52-8018ead92b7c', 'volume_name': 'volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a70f4c-8289-4b66-b7e1-48c4fca77a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a70f4c-8289-4b66-b7e1-48c4fca77a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659e5ba6-3480-452d-b0b7-83663cbe8bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:15 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Volume 93fe0b7c-70b3-4f86-ba52-8018ead92b7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c', 'volume_size': 1} Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:15 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-33499df0-0283-46ca-9ad5-cc7c857f9c23" returned: 0 in 0.760s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-33499df0-0283-46ca-9ad5-cc7c857f9c23" released by "delete_volume" :: held 1.729s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:15 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] Created reservations ['48c3e1eb-573a-4850-aa61-f2063cb90225', '428d71dd-eadf-4fcd-a243-04d841595bea', '811b0b4c-7974-474a-9faf-95bd687f0a75', '31dfe043-30b3-476b-a7ca-e95725dc0acb'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:19:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:16 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:19:16 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:16 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.info" returned: 0 in 0.769s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.117s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.238s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] Creating offline snapshot d2a3f4d8-aa1d-459f-97a2-d6ab710160b8 of volume 2ffc2441-c820-40d6-bf17-c3f455310bc8 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:19:16 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-189bb84b-5534-408f-80b5-e620ea5596cd tempest-VolumesExtendTest-1321307395 None] Create snapshot completed successfully Jul 09 14:19:16 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f5c9ea-fbf4-4265-9c5b-f387fbb3070d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:16 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8 Jul 09 14:19:16 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:16 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.787s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:16 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:19:16 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] Deleted volume successfully. Jul 09 14:19:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1a3239b0-f09e-48bc-8c07-54b54caa1824 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-33499df0-0283-46ca-9ad5-cc7c857f9c23-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:17 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:19:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Flow 'volume_create_manager' (f0ae4e9b-889b-4c4a-b133-48aa01fa97dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:19:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8df8af3-9661-4154-a1fb-0bdba258192d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8df8af3-9661-4154-a1fb-0bdba258192d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-956080222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3105ed-30ce-498a-97b8-f030cefc1f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8449f98c569944df9b37db8ac7f2b56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:19:17Z,use_quota=True,user_id='f8e98e41e8c849899537910621e35e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e86666e-dc2f-4d03-a3de-8f8ab0ad310c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e86666e-dc2f-4d03-a3de-8f8ab0ad310c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a014d6ee-39d4-4d53-bff5-5ec2257b7c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a014d6ee-39d4-4d53-bff5-5ec2257b7c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb3105ed-30ce-498a-97b8-f030cefc1f7f', 'volume_name': 'volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef4c127-cfaf-4e95-a648-a77a5a714704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef4c127-cfaf-4e95-a648-a77a5a714704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (739977a3-c813-4d3d-8024-d8a1275105a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:17 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Volume fb3105ed-30ce-498a-97b8-f030cefc1f7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f', 'volume_size': 1} Jul 09 14:19:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3b7568bd-028d-4c41-bfbb-7e3eb7129f6a tempest-VolumesExtendTest-1321307395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:17 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8" returned: 0 in 1.112s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:17 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8 1G Jul 09 14:19:17 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:18 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8 1G" returned: 0 in 0.867s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ffc2441-c820-40d6-bf17-c3f455310bc8 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:18 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ffc2441-c820-40d6-bf17-c3f455310bc8 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8 Jul 09 14:19:18 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:18 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ffc2441-c820-40d6-bf17-c3f455310bc8 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8" returned: 0 in 0.712s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:18 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 14:19:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:18 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8 Jul 09 14:19:18 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:19 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8" returned: 0 in 0.629s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:19 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.info Jul 09 14:19:19 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:20 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.info" returned: 0 in 0.707s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:20 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 14:19:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:20 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.info Jul 09 14:19:20 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:20 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.info" returned: 0 in 0.630s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.763s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.332s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-548616337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93fe0b7c-70b3-4f86-ba52-8018ead92b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8d4af57a1044bc8da3d66b8d76aa46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:19:15Z,use_quota=True,user_id='bab14b8e1a98439ab4ecb7ad584044b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:19:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Creating volume 93fe0b7c-70b3-4f86-ba52-8018ead92b7c {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:19:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:19:20 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:19:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:20 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c 1073741824 Jul 09 14:19:20 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:21 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-09934399-c77d-4137-a34a-e03323f69d69 tempest-GroupSnapshotsV319Test-1416005546 None] group_snapshot ce66fcc4-2b67-4aca-8c76-a7c46abbad3f: created successfully Jul 09 14:19:21 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] group_snapshot ce66fcc4-2b67-4aca-8c76-a7c46abbad3f: deleting Jul 09 14:19:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] group_snapshot ce66fcc4-2b67-4aca-8c76-a7c46abbad3f: deleting {{(pid=87011) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 14:19:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] Acquiring lock "cinder-quobyte-2ffc2441-c820-40d6-bf17-c3f455310bc8" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] Lock "cinder-quobyte-2ffc2441-c820-40d6-bf17-c3f455310bc8" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] Acquiring lock "cinder-quobyte-d2a3f4d8-aa1d-459f-97a2-d6ab710160b8" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] Lock "cinder-quobyte-d2a3f4d8-aa1d-459f-97a2-d6ab710160b8" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] Deleting offline snapshot d2a3f4d8-aa1d-459f-97a2-d6ab710160b8 of volume 2ffc2441-c820-40d6-bf17-c3f455310bc8 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:19:22 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] snapshot_file for this snap is: volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:19:22 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[245ae9ab-d52d-488a-9654-d51d9398d13a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:22 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c 1073741824" returned: 0 in 1.089s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:22 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c Jul 09 14:19:22 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:22 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8 Jul 09 14:19:22 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:23 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c" returned: 0 in 0.979s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:23 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] <== create_volume: return (2138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.848s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-956080222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3105ed-30ce-498a-97b8-f030cefc1f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8449f98c569944df9b37db8ac7f2b56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:19:17Z,use_quota=True,user_id='f8e98e41e8c849899537910621e35e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Creating volume fb3105ed-30ce-498a-97b8-f030cefc1f7f {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:19:23 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8" returned: 0 in 1.116s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ffc2441-c820-40d6-bf17-c3f455310bc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:19:23 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f 1073741824 Jul 09 14:19:23 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659e5ba6-3480-452d-b0b7-83663cbe8bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858aa54e-0f09-497b-ae9e-e370e75b3a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[243f26db-7da9-41b2-80d3-cb0c9b555e11]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:23 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Volume volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c (93fe0b7c-70b3-4f86-ba52-8018ead92b7c): created successfully Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858aa54e-0f09-497b-ae9e-e370e75b3a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Flow 'volume_create_manager' (51331d57-9fa1-4805-b625-118594bc5ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:19:23 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-0bc09148-da87-4ba6-9aae-2bc380dd5ea4 tempest-TestStampPattern-426171458 None] Created volume successfully. Jul 09 14:19:23 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8 Jul 09 14:19:23 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:24 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f 1073741824" returned: 0 in 1.118s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:24 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8" returned: 0 in 1.061s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:24 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8 Jul 09 14:19:24 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:24 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f Jul 09 14:19:24 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:24 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f" returned: 0 in 0.677s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:19:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3b7568bd-028d-4c41-bfbb-7e3eb7129f6a tempest-VolumesExtendTest-1321307395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 7.700s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (739977a3-c813-4d3d-8024-d8a1275105a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47050d4b-991f-4ceb-908a-ff3638f51200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:25 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fed1e61-040a-4631-9057-97872c45ba98]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3b7568bd-028d-4c41-bfbb-7e3eb7129f6a tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:25 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Volume volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f (fb3105ed-30ce-498a-97b8-f030cefc1f7f): created successfully Jul 09 14:19:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47050d4b-991f-4ceb-908a-ff3638f51200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Flow 'volume_create_manager' (f0ae4e9b-889b-4c4a-b133-48aa01fa97dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:19:25 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-f812b8b5-303a-4680-a6ba-0e7fcc6a0e6a tempest-VolumesSnapshotTestJSON-1345456126 None] Created volume successfully. Jul 09 14:19:25 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8" returned: 0 in 0.862s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:25 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf Jul 09 14:19:25 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:25 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8 Jul 09 14:19:25 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:25 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8.d2a3f4d8-aa1d-459f-97a2-d6ab710160b8" returned: 0 in 0.653s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:25 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] Lock "cinder-quobyte-d2a3f4d8-aa1d-459f-97a2-d6ab710160b8" released by "_delete_snapshot" :: held 3.870s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:25 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] Lock "cinder-quobyte-2ffc2441-c820-40d6-bf17-c3f455310bc8" released by "delete_snapshot" :: held 3.913s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:25 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3b7568bd-028d-4c41-bfbb-7e3eb7129f6a tempest-VolumesExtendTest-1321307395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf" returned: 0 in 0.858s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3b7568bd-028d-4c41-bfbb-7e3eb7129f6a tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad 2G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:25 devstack cinder-volume[87011]: WARNING cinder.quota [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2078915076 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2078915076, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:19:25 devstack cinder-volume[87011]: WARNING cinder.quota [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2078915076 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2078915076, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:19:25 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] Created reservations ['ce541581-b2c6-4e23-96ba-0a0fbbb042f2', 'c3a27d72-c715-46f8-85dc-ae7085a7bf83', '6542db61-21a1-424f-898a-bdb7ff262c88', '50923c43-31ad-4892-b6fc-66a87bf465fd'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:19:26 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a88f6601-158d-4381-b86c-0fce9d304998 tempest-GroupSnapshotsV319Test-1416005546 None] group_snapshot ce66fcc4-2b67-4aca-8c76-a7c46abbad3f: deleted successfully Jul 09 14:19:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3b7568bd-028d-4c41-bfbb-7e3eb7129f6a tempest-VolumesExtendTest-1321307395 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad 2G" returned: 0 in 0.184s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3b7568bd-028d-4c41-bfbb-7e3eb7129f6a tempest-VolumesExtendTest-1321307395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.104s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.119s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] Creating offline snapshot 285528a1-9704-46ea-b448-9f5817bb9675 of volume fb3105ed-30ce-498a-97b8-f030cefc1f7f {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:19:26 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[0275a63d-f0c8-4231-924a-dccc6738f5b4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:26 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-3b7568bd-028d-4c41-bfbb-7e3eb7129f6a tempest-VolumesExtendTest-1321307395 None] Extend volume completed successfully. Jul 09 14:19:26 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f Jul 09 14:19:26 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] Acquiring lock "cinder-quobyte-2ffc2441-c820-40d6-bf17-c3f455310bc8" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] Lock "cinder-quobyte-2ffc2441-c820-40d6-bf17-c3f455310bc8" acquired by "delete_volume" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:26 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[947823f5-9b95-46ad-9b37-87df64e0d170]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:26 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8 Jul 09 14:19:26 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:27 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f" returned: 0 in 0.906s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] Acquiring lock "cinder-5419e512-04fa-43fa-ad0f-087042958cad-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:27 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675 1G Jul 09 14:19:27 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] Lock "cinder-5419e512-04fa-43fa-ad0f-087042958cad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] Acquiring lock "cinder-quobyte-ff5938c4-7ba9-4870-a3d2-24b2855e00bf" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] Lock "cinder-quobyte-ff5938c4-7ba9-4870-a3d2-24b2855e00bf" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] Acquiring lock "cinder-quobyte-5419e512-04fa-43fa-ad0f-087042958cad" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] Lock "cinder-quobyte-5419e512-04fa-43fa-ad0f-087042958cad" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:27 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] Deleting offline snapshot 5419e512-04fa-43fa-ad0f-087042958cad of volume ff5938c4-7ba9-4870-a3d2-24b2855e00bf {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:19:27 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] snapshot_file for this snap is: volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:19:27 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80f13a2-bf44-4448-98e1-a0ed3ebae24c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:27 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad Jul 09 14:19:27 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:27 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8" returned: 0 in 1.074s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:27 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8 Jul 09 14:19:27 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:28 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675 1G" returned: 0 in 1.241s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:28 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675 Jul 09 14:19:28 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:28 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad" returned: 0 in 1.295s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:19:28 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2e1a99-96e5-4cd3-bf3b-eb766562cd08]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:28 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf Jul 09 14:19:28 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:28 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2ffc2441-c820-40d6-bf17-c3f455310bc8" returned: 0 in 1.149s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:28 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] Lock "cinder-quobyte-2ffc2441-c820-40d6-bf17-c3f455310bc8" released by "delete_volume" :: held 2.286s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:28 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] Created reservations ['1b9bea24-10cd-4a29-a2b7-8733a39fffcb'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:19:28 devstack cinder-volume[87011]: WARNING cinder.quota [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2078915076 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2078915076, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:19:28 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] Created reservations ['64ed1d0b-d5d6-4e29-a096-084891ca39c7', '2485c7e1-de37-4032-aacf-8c345423fc59', 'ac6e347f-fa60-4255-be0d-477cb1587973', '2c3c1d00-5889-458c-b4bd-f70018ce8356'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:19:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:29 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:19:29 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:29 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675" returned: 0 in 1.055s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:29 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675 is being set with open permissions: ugo+rw Jul 09 14:19:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:29 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675 Jul 09 14:19:29 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:29 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf" returned: 0 in 0.997s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:29 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad Jul 09 14:19:29 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:29 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.763s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:29 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:19:29 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-be670bd9-ec79-4571-8e29-2a3d9aa5967b tempest-GroupSnapshotsV319Test-1416005546 None] Delete group completed successfully. Jul 09 14:19:30 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675" returned: 0 in 0.739s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:30 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.info Jul 09 14:19:30 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:30 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad" returned: 0 in 1.032s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:30 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad Jul 09 14:19:30 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:31 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.info" returned: 0 in 0.966s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:31 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.info is being set with open permissions: ugo+rw Jul 09 14:19:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:31 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.info Jul 09 14:19:31 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:31 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf.5419e512-04fa-43fa-ad0f-087042958cad" returned: 0 in 1.004s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] Lock "cinder-quobyte-5419e512-04fa-43fa-ad0f-087042958cad" released by "_delete_snapshot" :: held 4.505s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] Lock "cinder-quobyte-ff5938c4-7ba9-4870-a3d2-24b2855e00bf" released by "delete_snapshot" :: held 4.535s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:31 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] Created reservations ['cf7681ab-9981-466d-b4d4-236ac3689920', '24061a18-fef7-479b-8d04-d71eeb3b8f05', '3742a0a5-b1d7-42c4-b747-a863585b6c08', 'c1060332-615c-401c-8421-f79f4a94d307'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:19:31 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] Delete snapshot completed successfully. Jul 09 14:19:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b4f40990-1186-4bd6-b7de-474e7f2963c2 tempest-VolumesExtendTest-1321307395 None] Lock "cinder-5419e512-04fa-43fa-ad0f-087042958cad-delete_snapshot" released by "delete_snapshot" :: held 4.735s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:32 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.info" returned: 0 in 1.025s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.070s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:32 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-77566d6a-2d9f-487a-8210-d140e78faa00 tempest-VolumesSnapshotTestJSON-1345456126 None] Create snapshot completed successfully Jul 09 14:19:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] Acquiring lock "cinder-ff5938c4-7ba9-4870-a3d2-24b2855e00bf-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] Lock "cinder-ff5938c4-7ba9-4870-a3d2-24b2855e00bf-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] Acquiring lock "cinder-quobyte-ff5938c4-7ba9-4870-a3d2-24b2855e00bf" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] Lock "cinder-quobyte-ff5938c4-7ba9-4870-a3d2-24b2855e00bf" acquired by "delete_volume" :: waited 0.033s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edebd14-d5d5-4fc0-b6f3-79dae7a888bb]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:33 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf Jul 09 14:19:33 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=133,cinder:SELECT=120,cinder:INSERT=32,cinder:DELETE=8 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=126,cinder:UPDATE=137,cinder:INSERT=43,cinder:DELETE=13 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Flow 'volume_create_manager' (3fb2777c-74b2-4465-b109-c705af616af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a5f4be-56c1-409b-b5ca-d08ed71192c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a5f4be-56c1-409b-b5ca-d08ed71192c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1455772894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8259c2ea-f073-4fa3-9d13-784c542b613c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8449f98c569944df9b37db8ac7f2b56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=285528a1-9704-46ea-b448-9f5817bb9675,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:19:33Z,use_quota=True,user_id='f8e98e41e8c849899537910621e35e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d242d61-9969-43d9-ba35-a633ad9029b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d242d61-9969-43d9-ba35-a633ad9029b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b601aad-0026-402f-a079-503a95dc36ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b601aad-0026-402f-a079-503a95dc36ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8259c2ea-f073-4fa3-9d13-784c542b613c', 'volume_name': 'volume-8259c2ea-f073-4fa3-9d13-784c542b613c', 'volume_size': 1, 'snapshot_id': '285528a1-9704-46ea-b448-9f5817bb9675'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba912c0-77d1-47d0-a8ca-624ea0ba9d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba912c0-77d1-47d0-a8ca-624ea0ba9d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0f8c7d-2eb7-4daf-87ea-1af24bdf1533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:33 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Volume 8259c2ea-f073-4fa3-9d13-784c542b613c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8259c2ea-f073-4fa3-9d13-784c542b613c', 'volume_size': 1, 'snapshot_id': '285528a1-9704-46ea-b448-9f5817bb9675'} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-quobyte-285528a1-9704-46ea-b448-9f5817bb9675-8259c2ea-f073-4fa3-9d13-784c542b613c" by "_create_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-285528a1-9704-46ea-b448-9f5817bb9675-8259c2ea-f073-4fa3-9d13-784c542b613c" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Creating volume 8259c2ea-f073-4fa3-9d13-784c542b613c from snapshot 285528a1-9704-46ea-b448-9f5817bb9675 {{(pid=87011) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-quobyte-8259c2ea-f073-4fa3-9d13-784c542b613c" by "_copy_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-8259c2ea-f073-4fa3-9d13-784c542b613c" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] snapshot: 285528a1-9704-46ea-b448-9f5817bb9675, volume: 8259c2ea-f073-4fa3-9d13-784c542b613c, {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[89235ed3-e4ab-4d2c-a5ea-89cf87b588e9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:33 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675 Jul 09 14:19:33 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:34 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf" returned: 0 in 1.168s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:34 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf Jul 09 14:19:34 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:35 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675" returned: 0 in 1.237s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:19:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 14:19:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Creating direct copy from snapshot {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 14:19:35 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5cd2a9-24d1-42dc-9c29-2f97d531bd78]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:35 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f Jul 09 14:19:35 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:35 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ff5938c4-7ba9-4870-a3d2-24b2855e00bf" returned: 0 in 1.145s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] Lock "cinder-quobyte-ff5938c4-7ba9-4870-a3d2-24b2855e00bf" released by "delete_volume" :: held 2.437s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:35 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] Created reservations ['57c8f1a1-b52d-402d-abff-c4345264f45e', 'de3713f9-84ba-41f5-90fb-fc2cc203e436', '97747d04-5f3e-4f78-bcf9-5c197465a5ae', '56054142-ccd0-4d33-a237-ecccf4742c73'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:19:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:35 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:19:35 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:36 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f" returned: 0 in 1.592s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:36 devstack cinder-volume[87011]: DEBUG cinder.utils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Path /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8259c2ea-f073-4fa3-9d13-784c542b613c not found in is_blk_device check {{(pid=87011) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 14:19:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8259c2ea-f073-4fa3-9d13-784c542b613c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:36 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8259c2ea-f073-4fa3-9d13-784c542b613c Jul 09 14:19:36 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:36 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.216s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:36 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:19:36 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] Deleted volume successfully. Jul 09 14:19:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-71c0ca1c-4480-4abc-942e-b829995adae9 tempest-VolumesExtendTest-1321307395 None] Lock "cinder-ff5938c4-7ba9-4870-a3d2-24b2855e00bf-delete_volume" released by "delete_volume" :: held 4.072s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:44 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8259c2ea-f073-4fa3-9d13-784c542b613c" returned: 0 in 7.732s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:44 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb27042-7c6e-4178-8ebd-19fa624a7b2f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:44 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f Jul 09 14:19:44 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:44 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:19:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Flow 'volume_create_manager' (8fa94f2d-2b05-47dc-a190-54e3992dcbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:19:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1c0f26-5770-44a2-8555-ad67188a860e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1c0f26-5770-44a2-8555-ad67188a860e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-436568946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1bf5e61-72ee-4d85-a3d7-66b2115f1868,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7ab174ab408473198772e75b2be704f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:19:45Z,use_quota=True,user_id='94d5c506fc0a42b3b57cbf3909b4cdb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211375d7-e2ad-4c87-849c-01da79c41b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211375d7-e2ad-4c87-849c-01da79c41b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e213dfc-9815-4c78-a874-bd64a24af4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e213dfc-9815-4c78-a874-bd64a24af4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1bf5e61-72ee-4d85-a3d7-66b2115f1868', 'volume_name': 'volume-b1bf5e61-72ee-4d85-a3d7-66b2115f1868', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9911a8cf-1e81-406d-8e13-01d50ebff9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9911a8cf-1e81-406d-8e13-01d50ebff9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04dff29d-7444-4d9b-b761-f788e73d6485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:44 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Volume b1bf5e61-72ee-4d85-a3d7-66b2115f1868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1bf5e61-72ee-4d85-a3d7-66b2115f1868', 'volume_size': 1} Jul 09 14:19:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:45 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f" returned: 0 in 1.032s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:45 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f, size 1024.00 MB, duration 7.73 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8259c2ea-f073-4fa3-9d13-784c542b613c {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:19:45 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Converted 1024.00 MB image at 132.40 MB/s Jul 09 14:19:45 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8259c2ea-f073-4fa3-9d13-784c542b613c is being set with open permissions: ugo+rw Jul 09 14:19:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8259c2ea-f073-4fa3-9d13-784c542b613c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:45 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8259c2ea-f073-4fa3-9d13-784c542b613c Jul 09 14:19:45 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:46 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8259c2ea-f073-4fa3-9d13-784c542b613c" returned: 0 in 0.624s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-8259c2ea-f073-4fa3-9d13-784c542b613c" released by "_copy_volume_from_snapshot" :: held 12.362s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-285528a1-9704-46ea-b448-9f5817bb9675-8259c2ea-f073-4fa3-9d13-784c542b613c" released by "_create_volume_from_snapshot" :: held 12.401s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.419s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.206s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-436568946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1bf5e61-72ee-4d85-a3d7-66b2115f1868,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7ab174ab408473198772e75b2be704f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:19:45Z,use_quota=True,user_id='94d5c506fc0a42b3b57cbf3909b4cdb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Creating volume b1bf5e61-72ee-4d85-a3d7-66b2115f1868 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:19:46 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b1bf5e61-72ee-4d85-a3d7-66b2115f1868 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:46 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b1bf5e61-72ee-4d85-a3d7-66b2115f1868 1073741824 Jul 09 14:19:46 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0f8c7d-2eb7-4daf-87ea-1af24bdf1533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8259c2ea-f073-4fa3-9d13-784c542b613c', 'volume_size': 1, 'snapshot_id': '285528a1-9704-46ea-b448-9f5817bb9675'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed997e12-667a-4e28-bfff-5c972822c7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:46 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Volume volume-8259c2ea-f073-4fa3-9d13-784c542b613c (8259c2ea-f073-4fa3-9d13-784c542b613c): created successfully Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed997e12-667a-4e28-bfff-5c972822c7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Flow 'volume_create_manager' (3fb2777c-74b2-4465-b109-c705af616af7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:19:46 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-2976d10b-2c95-46c5-a9c2-861cd68daf9b tempest-VolumesSnapshotTestJSON-1345456126 None] Created volume successfully. Jul 09 14:19:46 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b1bf5e61-72ee-4d85-a3d7-66b2115f1868 1073741824" returned: 0 in 0.862s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b1bf5e61-72ee-4d85-a3d7-66b2115f1868 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:47 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b1bf5e61-72ee-4d85-a3d7-66b2115f1868 Jul 09 14:19:47 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-8259c2ea-f073-4fa3-9d13-784c542b613c-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-8259c2ea-f073-4fa3-9d13-784c542b613c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-quobyte-8259c2ea-f073-4fa3-9d13-784c542b613c" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-8259c2ea-f073-4fa3-9d13-784c542b613c" acquired by "delete_volume" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:47 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1aa647a-c1a7-427d-8a08-8144f0df44a9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8259c2ea-f073-4fa3-9d13-784c542b613c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:47 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b1bf5e61-72ee-4d85-a3d7-66b2115f1868" returned: 0 in 0.681s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:19:47 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8259c2ea-f073-4fa3-9d13-784c542b613c Jul 09 14:19:47 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04dff29d-7444-4d9b-b761-f788e73d6485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1bf5e61-72ee-4d85-a3d7-66b2115f1868', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec15ef4-e601-4574-bb4e-679eab701787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:47 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Volume volume-b1bf5e61-72ee-4d85-a3d7-66b2115f1868 (b1bf5e61-72ee-4d85-a3d7-66b2115f1868): created successfully Jul 09 14:19:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec15ef4-e601-4574-bb4e-679eab701787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Flow 'volume_create_manager' (8fa94f2d-2b05-47dc-a190-54e3992dcbf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:19:47 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-db8e0db2-2967-4adf-be9a-1ae113e027e3 tempest-VolumesGetTest-2050916066 None] Created volume successfully. Jul 09 14:19:48 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8259c2ea-f073-4fa3-9d13-784c542b613c" returned: 0 in 0.822s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8259c2ea-f073-4fa3-9d13-784c542b613c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:48 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8259c2ea-f073-4fa3-9d13-784c542b613c Jul 09 14:19:48 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Flow 'volume_create_manager' (e92adcbe-4d86-46d7-b60b-cecb82e7ab77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f33b7024-089c-4960-982f-ae11f797dc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f33b7024-089c-4960-982f-ae11f797dc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:19:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-810864843',display_name='tempest-VolumesGetTest-Volume-923067780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ab174ab408473198772e75b2be704f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:19:49Z,use_quota=True,user_id='94d5c506fc0a42b3b57cbf3909b4cdb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d6bf48-8833-4d45-89fd-d6d9f9e4cfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d6bf48-8833-4d45-89fd-d6d9f9e4cfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc1e61f-e718-4788-8601-bfa95a6d5606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc1e61f-e718-4788-8601-bfa95a6d5606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa', 'volume_name': 'volume-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a69004c-5839-4285-aed5-ce6e1a312859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a69004c-5839-4285-aed5-ce6e1a312859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a45caf-b68b-4197-bbf7-15f2cc5828d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:48 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Volume 681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa', 'volume_size': 1} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:19:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-810864843',display_name='tempest-VolumesGetTest-Volume-923067780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ab174ab408473198772e75b2be704f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:19:49Z,use_quota=True,user_id='94d5c506fc0a42b3b57cbf3909b4cdb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Creating volume 681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:19:48 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:19:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:48 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa 1073741824 Jul 09 14:19:48 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:49 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8259c2ea-f073-4fa3-9d13-784c542b613c" returned: 0 in 0.786s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-8259c2ea-f073-4fa3-9d13-784c542b613c" released by "delete_volume" :: held 1.660s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] Created reservations ['4ff4cd48-6dd8-4731-9b49-1876a224d506', '76ef56b7-dad0-454b-84aa-b028564163aa', 'f339caf5-b0a5-4a4a-81b5-7e8b1f4f26d9', '3d70c188-4060-48a1-9b96-104d851b43d4'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:49 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:19:49 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-285528a1-9704-46ea-b448-9f5817bb9675-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-285528a1-9704-46ea-b448-9f5817bb9675-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-quobyte-fb3105ed-30ce-498a-97b8-f030cefc1f7f" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:49 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-fb3105ed-30ce-498a-97b8-f030cefc1f7f" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-quobyte-285528a1-9704-46ea-b448-9f5817bb9675" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa 1073741824" returned: 0 in 1.071s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-285528a1-9704-46ea-b448-9f5817bb9675" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] Deleting offline snapshot 285528a1-9704-46ea-b448-9f5817bb9675 of volume fb3105ed-30ce-498a-97b8-f030cefc1f7f {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] snapshot_file for this snap is: volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f79093-693e-4f36-9547-b453e34c6938]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:50 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa Jul 09 14:19:50 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:50 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675 Jul 09 14:19:50 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:50 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.027s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:50 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:19:50 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] Deleted volume successfully. Jul 09 14:19:50 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-18bff61c-d958-43f1-ba02-281ac8d02876 tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-8259c2ea-f073-4fa3-9d13-784c542b613c-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:50 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa" returned: 0 in 0.924s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] <== create_volume: return (2127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:19:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.131s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a45caf-b68b-4197-bbf7-15f2cc5828d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd4027b-5569-4991-8165-b446a5d80d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:50 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Volume volume-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa (681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa): created successfully Jul 09 14:19:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd4027b-5569-4991-8165-b446a5d80d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Flow 'volume_create_manager' (e92adcbe-4d86-46d7-b60b-cecb82e7ab77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:19:51 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-e333cb1d-50e7-459e-9315-ef6fd6e9f96b tempest-VolumesGetTest-2050916066 None] Created volume successfully. Jul 09 14:19:51 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675" returned: 0 in 1.116s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:19:51 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff3d0c2-39d9-4e77-ba06-81c525ee4c41]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:51 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f Jul 09 14:19:51 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:51 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f" returned: 0 in 0.804s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:51 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675 Jul 09 14:19:51 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] Acquiring lock "cinder-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] Lock "cinder-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] Acquiring lock "cinder-quobyte-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] Lock "cinder-quobyte-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa" acquired by "delete_volume" :: waited 0.012s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:52 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f93f2d2-7c0a-4602-a4be-bcce0fb45784]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:52 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa Jul 09 14:19:52 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:52 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675" returned: 0 in 0.878s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:52 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675 Jul 09 14:19:52 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:53 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa" returned: 0 in 0.858s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:53 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa Jul 09 14:19:53 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:53 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f.285528a1-9704-46ea-b448-9f5817bb9675" returned: 0 in 0.721s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-285528a1-9704-46ea-b448-9f5817bb9675" released by "_delete_snapshot" :: held 3.655s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-fb3105ed-30ce-498a-97b8-f030cefc1f7f" released by "delete_snapshot" :: held 3.697s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:53 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] Created reservations ['29c9ea2a-51ef-449e-94a3-b1b71a1634c2', '1fe9ee99-360e-4b33-bfbe-d57222af6817', 'f5b77ed7-3f6b-4331-8ef1-d7c31932f71d', 'd3ee6ac7-0255-4601-a63b-852ea90e1995'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:19:53 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] Delete snapshot completed successfully. Jul 09 14:19:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9aae6c3f-a78d-4280-a7a0-7de88aafe07d tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-285528a1-9704-46ea-b448-9f5817bb9675-delete_snapshot" released by "delete_snapshot" :: held 3.881s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:53 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa" returned: 0 in 0.709s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] Lock "cinder-quobyte-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa" released by "delete_volume" :: held 1.609s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:53 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] Created reservations ['7683f320-60c8-4b40-a0e9-e32b0978205e', 'cb5907b6-b026-4d0b-b8e6-5484bf6772f0', '6a047764-3a2d-4060-b876-f2444d8286b7', 'c494721a-78f1-4d6a-9c09-6cd3b807aa45'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:19:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:53 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:19:53 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-fb3105ed-30ce-498a-97b8-f030cefc1f7f-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-fb3105ed-30ce-498a-97b8-f030cefc1f7f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-quobyte-fb3105ed-30ce-498a-97b8-f030cefc1f7f" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-fb3105ed-30ce-498a-97b8-f030cefc1f7f" acquired by "delete_volume" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:54 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b4ea83-c28c-4fbd-a07a-991e3a0edab0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] Acquiring lock "cinder-b1bf5e61-72ee-4d85-a3d7-66b2115f1868-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] Lock "cinder-b1bf5e61-72ee-4d85-a3d7-66b2115f1868-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:54 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f Jul 09 14:19:54 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] Acquiring lock "cinder-quobyte-b1bf5e61-72ee-4d85-a3d7-66b2115f1868" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] Lock "cinder-quobyte-b1bf5e61-72ee-4d85-a3d7-66b2115f1868" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:54 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee04da3c-2968-4091-9cc8-38f5811f8e41]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b1bf5e61-72ee-4d85-a3d7-66b2115f1868 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:54 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.802s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:54 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:19:54 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] Deleted volume successfully. Jul 09 14:19:54 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b1bf5e61-72ee-4d85-a3d7-66b2115f1868 Jul 09 14:19:54 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c3f64ca2-30b4-4156-a37a-38b9008306b3 tempest-VolumesGetTest-2050916066 None] Lock "cinder-681b87a6-f2c1-4f5a-85ca-1ddf86dd59aa-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:55 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f" returned: 0 in 0.996s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:55 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f Jul 09 14:19:55 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:55 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b1bf5e61-72ee-4d85-a3d7-66b2115f1868" returned: 0 in 0.898s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b1bf5e61-72ee-4d85-a3d7-66b2115f1868 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:55 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b1bf5e61-72ee-4d85-a3d7-66b2115f1868 Jul 09 14:19:55 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:56 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-fb3105ed-30ce-498a-97b8-f030cefc1f7f" returned: 0 in 0.852s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-fb3105ed-30ce-498a-97b8-f030cefc1f7f" released by "delete_volume" :: held 1.940s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-855d40cd-4c00-41c1-8e02-8c7a00367a84 req-0ca5212d-f573-4afd-a473-84a95bda8aba tempest-TestStampPattern-426171458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-855d40cd-4c00-41c1-8e02-8c7a00367a84 req-0ca5212d-f573-4afd-a473-84a95bda8aba tempest-TestStampPattern-426171458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4ac221-1f2e-469e-bda9-463d6234e509]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-855d40cd-4c00-41c1-8e02-8c7a00367a84 req-0ca5212d-f573-4afd-a473-84a95bda8aba tempest-TestStampPattern-426171458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] Created reservations ['0a9dd2c6-f07f-4b77-bb60-5ec7d6640d3d', 'd5564dd2-0c1c-46a0-8f70-64602007f2c7', 'c5369adc-ea0a-43ef-b28b-c9e5ba01d15e', '7688e065-d77a-461f-9c8c-39b238404f94'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:19:56 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-b1bf5e61-72ee-4d85-a3d7-66b2115f1868" returned: 0 in 0.836s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] Lock "cinder-quobyte-b1bf5e61-72ee-4d85-a3d7-66b2115f1868" released by "delete_volume" :: held 1.801s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:56 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c Jul 09 14:19:56 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:56 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:19:56 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] Created reservations ['a81ab73d-e430-44d4-84ac-96091fb64f49', '69efd73c-5600-4ece-ae42-a2b47ef4215f', 'b5ff9f48-8f74-4a9f-b8d0-0a98e8a05412', '0d08bea4-342f-4f9f-84af-1186872662f8'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:56 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:19:56 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "cinder-quobyte-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5" acquired by "delete_volume" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde8520e-bbf7-4eeb-8d08-7565f4d19159]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:19:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:57 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 Jul 09 14:19:57 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:57 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-855d40cd-4c00-41c1-8e02-8c7a00367a84 req-0ca5212d-f573-4afd-a473-84a95bda8aba tempest-TestStampPattern-426171458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c" returned: 0 in 1.162s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-855d40cd-4c00-41c1-8e02-8c7a00367a84 req-0ca5212d-f573-4afd-a473-84a95bda8aba tempest-TestStampPattern-426171458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.196s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-855d40cd-4c00-41c1-8e02-8c7a00367a84 req-0ca5212d-f573-4afd-a473-84a95bda8aba tempest-TestStampPattern-426171458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8cebb124-abb4-44ed-9150-d9f297a3c000', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:19:57 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-855d40cd-4c00-41c1-8e02-8c7a00367a84 req-0ca5212d-f573-4afd-a473-84a95bda8aba tempest-TestStampPattern-426171458 None] attachment_update completed successfully. Jul 09 14:19:57 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.399s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:57 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:19:57 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] Deleted volume successfully. Jul 09 14:19:57 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:19:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Flow 'volume_create_manager' (f43bd812-be90-4852-a7c6-13b28e6b015e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:19:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb600ec-61ab-428b-87cc-054346b98037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb600ec-61ab-428b-87cc-054346b98037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1423341933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f26ce8eb-7cf9-4e8f-98d6-178254b703f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ab174ab408473198772e75b2be704f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:19:58Z,use_quota=True,user_id='94d5c506fc0a42b3b57cbf3909b4cdb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912e0670-37e1-4b8c-b520-a4de4a6e39e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912e0670-37e1-4b8c-b520-a4de4a6e39e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5a289d-3953-414b-b88a-12f04a812f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5a289d-3953-414b-b88a-12f04a812f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f26ce8eb-7cf9-4e8f-98d6-178254b703f8', 'volume_name': 'volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ccbea25-1362-4ec5-b863-69ffb872f419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ccbea25-1362-4ec5-b863-69ffb872f419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:19:57 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ceaabc-c0d0-4845-828d-4eadd172c10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:19:58 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Volume f26ce8eb-7cf9-4e8f-98d6-178254b703f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8', 'volume_size': 1} Jul 09 14:19:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1423341933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f26ce8eb-7cf9-4e8f-98d6-178254b703f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ab174ab408473198772e75b2be704f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:19:58Z,use_quota=True,user_id='94d5c506fc0a42b3b57cbf3909b4cdb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:19:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Creating volume f26ce8eb-7cf9-4e8f-98d6-178254b703f8 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:19:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:19:58 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:19:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a3340afd-8dd8-4e5f-ab55-5cfad9ed2a6e tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-fb3105ed-30ce-498a-97b8-f030cefc1f7f-delete_volume" released by "delete_volume" :: held 3.887s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.412s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:58 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:19:58 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] Deleted volume successfully. Jul 09 14:19:58 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 1073741824 Jul 09 14:19:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf728763-2947-4eb1-b2a6-3b126f784c07 tempest-VolumesGetTest-2050916066 None] Lock "cinder-b1bf5e61-72ee-4d85-a3d7-66b2115f1868-delete_volume" released by "delete_volume" :: held 3.626s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:58 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:58 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5" returned: 0 in 1.480s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:58 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5 Jul 09 14:19:58 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:59 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5" returned: 0 in 0.756s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-quobyte-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5" released by "delete_volume" :: held 2.379s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:19:59 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 1073741824" returned: 0 in 1.148s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:19:59 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] Created reservations ['ccb5e77e-ad3d-4f59-b0b2-a207a6064b86', 'f6117522-c25c-4a45-be45-7e900d2ec623', 'aea1ca32-d164-48c6-9951-a5d44b41dc58', '97ca85e3-1a9b-423c-a422-35b8f612313a'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:19:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:59 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 Jul 09 14:19:59 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:19:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:19:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:19:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:19:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:19:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:19:59 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:19:59 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:19:59 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Jul 09 14:19:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8" returned: 0 in 0.770s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:20:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ceaabc-c0d0-4845-828d-4eadd172c10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1d41c3-12b6-46e2-93be-32f83c08a936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:00 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Volume volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 (f26ce8eb-7cf9-4e8f-98d6-178254b703f8): created successfully Jul 09 14:20:00 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1d41c3-12b6-46e2-93be-32f83c08a936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Flow 'volume_create_manager' (f43bd812-be90-4852-a7c6-13b28e6b015e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:20:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.773s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:00 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:20:00 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] Deleted volume successfully. Jul 09 14:20:00 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a28719da-95da-49da-a559-1a44a4929ce6 tempest-VolumesGetTest-2050916066 None] Created volume successfully. Jul 09 14:20:00 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-208a313e-3618-4a1d-9b50-bc0fb5bdc6eb tempest-VolumesSnapshotTestJSON-1345456126 None] Lock "cinder-2b24eb56-5c8d-498d-8dd0-ca2890cba4b5-delete_volume" released by "delete_volume" :: held 3.473s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:01 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:20:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Flow 'volume_create_manager' (fe8aabd9-852c-4cec-8248-9414bbbe01f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:20:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c65ef8b-d0e1-4731-9f9c-10053992c873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c65ef8b-d0e1-4731-9f9c-10053992c873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-863904665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662b2c50-df9d-4c41-8e8d-2a4ef98e3f17,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7ab174ab408473198772e75b2be704f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f26ce8eb-7cf9-4e8f-98d6-178254b703f8,status='creating',terminated_at=None,updated_at=2026-07-09T12:20:02Z,use_quota=True,user_id='94d5c506fc0a42b3b57cbf3909b4cdb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e5368a-10ec-4017-ae0c-b4f7b26b0dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54e5368a-10ec-4017-ae0c-b4f7b26b0dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa9e3d2-3c25-4e79-aa13-551d471f2b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa9e3d2-3c25-4e79-aa13-551d471f2b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '662b2c50-df9d-4c41-8e8d-2a4ef98e3f17', 'volume_name': 'volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17', 'volume_size': 1, 'source_volid': 'f26ce8eb-7cf9-4e8f-98d6-178254b703f8', 'source_volstatus': 'available'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156500c6-3185-4671-93d2-29e1bc327c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156500c6-3185-4671-93d2-29e1bc327c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ceabbdd-b046-47f4-a395-3cab3c90c77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:01 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Volume 662b2c50-df9d-4c41-8e8d-2a4ef98e3f17: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17', 'volume_size': 1, 'source_volid': 'f26ce8eb-7cf9-4e8f-98d6-178254b703f8', 'source_volstatus': 'available'} Jul 09 14:20:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:01 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Cloning volume f26ce8eb-7cf9-4e8f-98d6-178254b703f8 to volume 662b2c50-df9d-4c41-8e8d-2a4ef98e3f17 Jul 09 14:20:01 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Creating offline snapshot e40d0d33-b3ad-436d-b50c-6d866ec51ba3 of volume f26ce8eb-7cf9-4e8f-98d6-178254b703f8 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:20:01 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[0197025e-0ebf-4c85-a10d-df7656597a09]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:02 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 Jul 09 14:20:02 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:03 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8" returned: 0 in 1.171s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:03 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3 1G Jul 09 14:20:03 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:04 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3 1G" returned: 0 in 1.271s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:04 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3 Jul 09 14:20:04 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:04 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:20:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Flow 'volume_create_manager' (69a7c211-b2b5-47b4-b962-2cbac861ff88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:20:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45377b30-02fc-4fbf-8f9d-b40f2dad44a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45377b30-02fc-4fbf-8f9d-b40f2dad44a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1083585247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68297ac0-3617-44df-9daa-d0492240a3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b869e5a3124764a87c777af3b3c6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:20:05Z,use_quota=True,user_id='94206011ded94cc5978115f246f67fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcdf034-00c4-4753-b4bc-68313a4f6d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcdf034-00c4-4753-b4bc-68313a4f6d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ddfae5-01bd-4dbb-ab96-c7348207286e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ddfae5-01bd-4dbb-ab96-c7348207286e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68297ac0-3617-44df-9daa-d0492240a3f6', 'volume_name': 'volume-68297ac0-3617-44df-9daa-d0492240a3f6', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad6d9c4-7f0c-4ec0-a9ec-a03a7d525876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad6d9c4-7f0c-4ec0-a9ec-a03a7d525876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d39c60-64d6-4514-971c-7c360220a084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:04 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Volume 68297ac0-3617-44df-9daa-d0492240a3f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68297ac0-3617-44df-9daa-d0492240a3f6', 'volume_size': 1} Jul 09 14:20:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:05 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3" returned: 0 in 0.971s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:05 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3 is being set with open permissions: ugo+rw Jul 09 14:20:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:05 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3 Jul 09 14:20:05 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:06 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3" returned: 0 in 0.759s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:06 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.info Jul 09 14:20:06 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:06 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.info" returned: 0 in 0.666s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:06 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.info is being set with open permissions: ugo+rw Jul 09 14:20:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:06 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.info Jul 09 14:20:06 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:07 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.info" returned: 0 in 0.682s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Acquiring lock "cinder-quobyte-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17" by "_copy_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Lock "cinder-quobyte-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] snapshot: e40d0d33-b3ad-436d-b50c-6d866ec51ba3, volume: 662b2c50-df9d-4c41-8e8d-2a4ef98e3f17, {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bd25f4-b9b1-48fc-96c7-2912aa115f04]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:07 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-0ef6f8cb-e01e-4389-aad9-5cbfe9d5cfaf req-c3d8799a-f1e3-4922-9f56-cf3f649a7283 tempest-TestStampPattern-426171458 None] Terminate volume connection completed successfully. Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-0ef6f8cb-e01e-4389-aad9-5cbfe9d5cfaf req-c3d8799a-f1e3-4922-9f56-cf3f649a7283 tempest-TestStampPattern-426171458 None] Deleting attachment 8cebb124-abb4-44ed-9150-d9f297a3c000. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:20:07 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3 Jul 09 14:20:07 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Flow 'volume_create_manager' (a59f749f-ea7f-45d4-bc26-efc27e012f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c9c59d9-6fac-445b-971c-cf63bce8ba55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c9c59d9-6fac-445b-971c-cf63bce8ba55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-961927533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0e387b-89ef-4a1e-b1a1-5d12873987f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eb7895fc9864e9287bf4c3180d7dae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:20:08Z,use_quota=True,user_id='1ef70aabdd6549a0a353e5454bac9b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02da7e7a-7349-48f0-960a-24cd209b0fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02da7e7a-7349-48f0-960a-24cd209b0fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a5746d-cfff-4eb0-b54c-9728df7fa895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a5746d-cfff-4eb0-b54c-9728df7fa895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc0e387b-89ef-4a1e-b1a1-5d12873987f7', 'volume_name': 'volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0e4acb-d38e-4844-b930-cced518595f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0e4acb-d38e-4844-b930-cced518595f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dab67ec-393a-4d61-8100-642bf4d91365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:07 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Volume bc0e387b-89ef-4a1e-b1a1-5d12873987f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7', 'volume_size': 1} Jul 09 14:20:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:08 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3" returned: 0 in 0.788s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:20:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 14:20:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Creating direct copy from snapshot {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 14:20:08 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[49da7286-be38-4dc0-9094-c78c4b0163d5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:08 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 Jul 09 14:20:08 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:09 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8" returned: 0 in 0.936s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:09 devstack cinder-volume[87011]: DEBUG cinder.utils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Path /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17 not found in is_blk_device check {{(pid=87011) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 14:20:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:09 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17 Jul 09 14:20:09 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:20:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:20:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:20:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:12 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:20:12 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:14 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.510s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:14 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:20:14 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:20:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:20:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:20:14 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17" returned: 0 in 4.865s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:14 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a78c3e3-f5ac-4458-954b-b43d9d027616]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:14 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 Jul 09 14:20:14 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:15 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8" returned: 0 in 0.893s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:15 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8, size 1024.00 MB, duration 4.87 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17 {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:20:15 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Converted 1024.00 MB image at 210.43 MB/s Jul 09 14:20:15 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17 is being set with open permissions: ugo+rw Jul 09 14:20:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:15 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17 Jul 09 14:20:15 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:15 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17" returned: 0 in 0.621s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:15 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Lock "cinder-quobyte-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17" released by "_copy_volume_from_snapshot" :: held 8.213s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:15 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Acquiring lock "cinder-quobyte-e40d0d33-b3ad-436d-b50c-6d866ec51ba3" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:15 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Lock "cinder-quobyte-e40d0d33-b3ad-436d-b50c-6d866ec51ba3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Deleting offline snapshot e40d0d33-b3ad-436d-b50c-6d866ec51ba3 of volume f26ce8eb-7cf9-4e8f-98d6-178254b703f8 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:20:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] snapshot_file for this snap is: volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:20:15 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2936112-1564-4563-9114-770060cc076f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:15 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3 Jul 09 14:20:15 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:16 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3" returned: 0 in 0.742s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:20:16 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[054d2b57-5ced-4fee-9b04-160311f2c5fb]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:16 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 Jul 09 14:20:16 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:17 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8" returned: 0 in 0.725s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:17 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3 Jul 09 14:20:17 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:18 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3" returned: 0 in 0.711s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:18 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3 Jul 09 14:20:18 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:18 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8.e40d0d33-b3ad-436d-b50c-6d866ec51ba3" returned: 0 in 0.612s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Lock "cinder-quobyte-e40d0d33-b3ad-436d-b50c-6d866ec51ba3" released by "_delete_snapshot" :: held 2.877s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.854s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.760s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1083585247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68297ac0-3617-44df-9daa-d0492240a3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b869e5a3124764a87c777af3b3c6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:20:05Z,use_quota=True,user_id='94206011ded94cc5978115f246f67fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Creating volume 68297ac0-3617-44df-9daa-d0492240a3f6 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:20:18 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-68297ac0-3617-44df-9daa-d0492240a3f6 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ceabbdd-b046-47f4-a395-3cab3c90c77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17', 'volume_size': 1, 'source_volid': 'f26ce8eb-7cf9-4e8f-98d6-178254b703f8', 'source_volstatus': 'available'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:18 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-68297ac0-3617-44df-9daa-d0492240a3f6 1073741824 Jul 09 14:20:18 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf96f17-1a51-47c6-9a07-93a0fd52272f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:18 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Volume volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17 (662b2c50-df9d-4c41-8e8d-2a4ef98e3f17): created successfully Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf96f17-1a51-47c6-9a07-93a0fd52272f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:18 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Flow 'volume_create_manager' (fe8aabd9-852c-4cec-8248-9414bbbe01f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:20:18 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-8e01a9a0-4664-42b1-a310-06b46ac7f9ab tempest-VolumesGetTest-2050916066 None] Created volume successfully. Jul 09 14:20:19 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-68297ac0-3617-44df-9daa-d0492240a3f6 1073741824" returned: 0 in 0.886s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-68297ac0-3617-44df-9daa-d0492240a3f6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:19 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:20:19 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-68297ac0-3617-44df-9daa-d0492240a3f6 Jul 09 14:20:19 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Flow 'volume_create_manager' (691cf7c7-df1e-483e-892b-23156a84527d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:20:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a4bf74-e46f-4659-a933-4eecbc7ca21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a4bf74-e46f-4659-a933-4eecbc7ca21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:20:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-723474049',display_name='tempest-VolumesGetTest-Volume-204142155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cafac56-31c9-41ee-b8ef-bce4b321cf7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ab174ab408473198772e75b2be704f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:20:20Z,use_quota=True,user_id='94d5c506fc0a42b3b57cbf3909b4cdb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c59bef-de69-453b-a5dc-df412191cdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c59bef-de69-453b-a5dc-df412191cdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33068ad8-264b-4e02-be63-382973363178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33068ad8-264b-4e02-be63-382973363178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cafac56-31c9-41ee-b8ef-bce4b321cf7a', 'volume_name': 'volume-9cafac56-31c9-41ee-b8ef-bce4b321cf7a', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60be206b-0bb4-44cc-a5f0-9330e9c4d183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60be206b-0bb4-44cc-a5f0-9330e9c4d183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0460269-5669-47d9-b281-3fce3f706aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:19 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Volume 9cafac56-31c9-41ee-b8ef-bce4b321cf7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cafac56-31c9-41ee-b8ef-bce4b321cf7a', 'volume_size': 1} Jul 09 14:20:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:20 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-68297ac0-3617-44df-9daa-d0492240a3f6" returned: 0 in 0.631s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:20:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.466s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-961927533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0e387b-89ef-4a1e-b1a1-5d12873987f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eb7895fc9864e9287bf4c3180d7dae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:20:08Z,use_quota=True,user_id='1ef70aabdd6549a0a353e5454bac9b34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:20:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Creating volume bc0e387b-89ef-4a1e-b1a1-5d12873987f7 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:20:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:20:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:20:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:20:20 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:20:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d39c60-64d6-4514-971c-7c360220a084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68297ac0-3617-44df-9daa-d0492240a3f6', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:20 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7 1073741824 Jul 09 14:20:20 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cec342b-577c-4683-ba3c-bb1fd99f29f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:20 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Volume volume-68297ac0-3617-44df-9daa-d0492240a3f6 (68297ac0-3617-44df-9daa-d0492240a3f6): created successfully Jul 09 14:20:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cec342b-577c-4683-ba3c-bb1fd99f29f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Flow 'volume_create_manager' (69a7c211-b2b5-47b4-b962-2cbac861ff88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:20:20 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-00fe22b7-f9b2-414f-a070-f0f19986cfa9 tempest-AbsoluteLimitsTests-42472903 None] Created volume successfully. Jul 09 14:20:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] Acquiring lock "cinder-68297ac0-3617-44df-9daa-d0492240a3f6-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] Lock "cinder-68297ac0-3617-44df-9daa-d0492240a3f6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] Acquiring lock "cinder-quobyte-68297ac0-3617-44df-9daa-d0492240a3f6" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] Lock "cinder-quobyte-68297ac0-3617-44df-9daa-d0492240a3f6" acquired by "delete_volume" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:21 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56fa50c-01b3-49f9-b81b-bda5d79e9c16]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-68297ac0-3617-44df-9daa-d0492240a3f6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:21 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7 1073741824" returned: 0 in 0.939s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:21 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-68297ac0-3617-44df-9daa-d0492240a3f6 Jul 09 14:20:21 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:21 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7 Jul 09 14:20:21 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:21 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-68297ac0-3617-44df-9daa-d0492240a3f6" returned: 0 in 0.756s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-68297ac0-3617-44df-9daa-d0492240a3f6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:21 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-68297ac0-3617-44df-9daa-d0492240a3f6 Jul 09 14:20:21 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:21 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7" returned: 0 in 0.653s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:20:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.165s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:22 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] Creating offline snapshot 2444418e-efa1-4e50-abaa-031fc43d90cf of volume 93fe0b7c-70b3-4f86-ba52-8018ead92b7c {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:20:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dab67ec-393a-4d61-8100-642bf4d91365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f6da32-2ee7-4b2c-accc-f4bbc803b27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:22 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[964880f8-7c29-451b-88c8-1b62d63ebcf3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:22 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Volume volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7 (bc0e387b-89ef-4a1e-b1a1-5d12873987f7): created successfully Jul 09 14:20:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f6da32-2ee7-4b2c-accc-f4bbc803b27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:22 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Flow 'volume_create_manager' (a59f749f-ea7f-45d4-bc26-efc27e012f9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:20:22 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c2258058-5ada-469f-af9b-17ff46f14c18 tempest-VolumesSnapshotListTestJSON-1315121760 None] Created volume successfully. Jul 09 14:20:22 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c Jul 09 14:20:22 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:22 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-68297ac0-3617-44df-9daa-d0492240a3f6" returned: 0 in 0.628s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] Lock "cinder-quobyte-68297ac0-3617-44df-9daa-d0492240a3f6" released by "delete_volume" :: held 1.422s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:22 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] Created reservations ['7a85b770-8bdd-43fa-9a9b-dab26fdf426c', 'f3ae41bf-2461-4173-a225-1cde133095b4', '7dae1913-965e-4e4f-a1ff-6859dfd3ae71', '53a102cf-35a3-484d-811e-13e271f47511'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:20:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:22 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:20:22 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:20:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:22 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:20:22 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:22 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c" returned: 0 in 0.825s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:22 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf 1G Jul 09 14:20:22 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:23 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.669s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:23 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:20:23 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] Deleted volume successfully. Jul 09 14:20:23 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fbc748ce-e9fb-4ed5-936f-4d12f69c9490 tempest-AbsoluteLimitsTests-42472903 None] Lock "cinder-68297ac0-3617-44df-9daa-d0492240a3f6-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:23 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf 1G" returned: 0 in 0.865s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:23 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf Jul 09 14:20:23 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:24 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf" returned: 0 in 0.724s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:24 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf is being set with open permissions: ugo+rw Jul 09 14:20:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:24 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf Jul 09 14:20:24 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:25 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf" returned: 0 in 0.675s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:25 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.info Jul 09 14:20:25 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:25 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.info" returned: 0 in 0.661s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:25 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.info is being set with open permissions: ugo+rw Jul 09 14:20:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:25 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.info Jul 09 14:20:25 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:26 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.info" returned: 0 in 0.651s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.504s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.676s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:20:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-723474049',display_name='tempest-VolumesGetTest-Volume-204142155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cafac56-31c9-41ee-b8ef-bce4b321cf7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ab174ab408473198772e75b2be704f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:20:20Z,use_quota=True,user_id='94d5c506fc0a42b3b57cbf3909b4cdb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:20:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Creating volume 9cafac56-31c9-41ee-b8ef-bce4b321cf7a {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:20:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:20:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:20:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:20:26 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:20:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9cafac56-31c9-41ee-b8ef-bce4b321cf7a 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:26 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9cafac56-31c9-41ee-b8ef-bce4b321cf7a 1073741824 Jul 09 14:20:26 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:26 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-55a52382-de74-44b5-ab0b-4da6a8484507 tempest-TestStampPattern-426171458 None] Create snapshot completed successfully Jul 09 14:20:27 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9cafac56-31c9-41ee-b8ef-bce4b321cf7a 1073741824" returned: 0 in 0.881s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9cafac56-31c9-41ee-b8ef-bce4b321cf7a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:27 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9cafac56-31c9-41ee-b8ef-bce4b321cf7a Jul 09 14:20:27 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:28 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9cafac56-31c9-41ee-b8ef-bce4b321cf7a" returned: 0 in 0.733s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.031s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] Creating offline snapshot 550cc676-5423-47e6-a8d8-5a3dfeb0ce5f of volume bc0e387b-89ef-4a1e-b1a1-5d12873987f7 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0460269-5669-47d9-b281-3fce3f706aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cafac56-31c9-41ee-b8ef-bce4b321cf7a', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e7ae02-2f0d-4624-9090-8fd0e816ad49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f2dac5-0350-4a47-bb89-1ff4df658703]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:28 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Volume volume-9cafac56-31c9-41ee-b8ef-bce4b321cf7a (9cafac56-31c9-41ee-b8ef-bce4b321cf7a): created successfully Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e7ae02-2f0d-4624-9090-8fd0e816ad49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Flow 'volume_create_manager' (691cf7c7-df1e-483e-892b-23156a84527d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:20:28 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-07a83b40-3052-4c35-93c4-ff6ae4966fd8 tempest-VolumesGetTest-2050916066 None] Created volume successfully. Jul 09 14:20:28 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7 Jul 09 14:20:28 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Flow 'volume_create_manager' (a594028a-8283-49ea-b0b7-7368b2eeaae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61ad1ae-b3d7-4efa-804b-cb5e41f21aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61ad1ae-b3d7-4efa-804b-cb5e41f21aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-127593797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3469a1a0-0b09-49eb-ad74-ed1c7ec6b487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846dd70d81014425a574e04386cdac1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:20:29Z,use_quota=True,user_id='fa96546fbb394e8e85b7537db0471507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f2d7bd-466b-4220-97cf-47037ee09171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f2d7bd-466b-4220-97cf-47037ee09171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9fee504-4833-4ab8-b335-781e7e54c084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9fee504-4833-4ab8-b335-781e7e54c084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3469a1a0-0b09-49eb-ad74-ed1c7ec6b487', 'volume_name': 'volume-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac4eb7b-f8a6-4db5-bd75-ebcaade8ea55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac4eb7b-f8a6-4db5-bd75-ebcaade8ea55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba40018-1e20-4682-b40a-1f1442fbb787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:28 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Volume 3469a1a0-0b09-49eb-ad74-ed1c7ec6b487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487', 'volume_size': 1} Jul 09 14:20:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:29 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7" returned: 0 in 0.819s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:29 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f 1G Jul 09 14:20:29 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] Acquiring lock "cinder-9cafac56-31c9-41ee-b8ef-bce4b321cf7a-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] Lock "cinder-9cafac56-31c9-41ee-b8ef-bce4b321cf7a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] Acquiring lock "cinder-quobyte-9cafac56-31c9-41ee-b8ef-bce4b321cf7a" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] Lock "cinder-quobyte-9cafac56-31c9-41ee-b8ef-bce4b321cf7a" acquired by "delete_volume" :: waited 0.014s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:29 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a931196-c3fd-42d1-b785-9d281759818e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9cafac56-31c9-41ee-b8ef-bce4b321cf7a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:29 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9cafac56-31c9-41ee-b8ef-bce4b321cf7a Jul 09 14:20:29 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:29 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f 1G" returned: 0 in 0.814s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:29 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f Jul 09 14:20:29 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:30 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9cafac56-31c9-41ee-b8ef-bce4b321cf7a" returned: 0 in 0.830s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9cafac56-31c9-41ee-b8ef-bce4b321cf7a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:30 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9cafac56-31c9-41ee-b8ef-bce4b321cf7a Jul 09 14:20:30 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:30 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f" returned: 0 in 0.690s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:30 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f is being set with open permissions: ugo+rw Jul 09 14:20:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:30 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f Jul 09 14:20:30 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:31 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-9cafac56-31c9-41ee-b8ef-bce4b321cf7a" returned: 0 in 0.687s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] Lock "cinder-quobyte-9cafac56-31c9-41ee-b8ef-bce4b321cf7a" released by "delete_volume" :: held 1.553s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] Created reservations ['c677ca51-49cf-4712-bbf1-4adb02cc33d2', 'bb1f769b-1812-41bd-a5ae-8235d7837b86', 'b35edcf8-618b-4407-880c-1f112e890f08', '9e69ddc9-bd80-48aa-ae2c-feb56e0d3311'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:31 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:20:31 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:31 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f" returned: 0 in 0.688s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:31 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.info Jul 09 14:20:31 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] Acquiring lock "cinder-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] Lock "cinder-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] Acquiring lock "cinder-quobyte-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] Lock "cinder-quobyte-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17" acquired by "delete_volume" :: waited 0.031s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:31 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.692s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:20:31 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] Deleted volume successfully. Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3fe63a-1ce6-4325-a569-3ac67eb41eb3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1eb2d949-3c84-4962-8b28-9ec78caccbd1 tempest-VolumesGetTest-2050916066 None] Lock "cinder-9cafac56-31c9-41ee-b8ef-bce4b321cf7a-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:31 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.info" returned: 0 in 0.706s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:31 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.info is being set with open permissions: ugo+rw Jul 09 14:20:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:32 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.info Jul 09 14:20:32 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:32 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17 Jul 09 14:20:32 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:32 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17" returned: 0 in 0.806s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:32 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.info" returned: 0 in 0.718s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:32 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17 Jul 09 14:20:32 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.562s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.775s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-127593797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3469a1a0-0b09-49eb-ad74-ed1c7ec6b487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846dd70d81014425a574e04386cdac1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:20:29Z,use_quota=True,user_id='fa96546fbb394e8e85b7537db0471507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:20:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Creating volume 3469a1a0-0b09-49eb-ad74-ed1c7ec6b487 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:20:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:20:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:20:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:20:32 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:20:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:32 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487 1073741824 Jul 09 14:20:32 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:32 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-bb57c993-1de9-4b2a-8147-bd828120bdf2 tempest-VolumesSnapshotListTestJSON-1315121760 None] Create snapshot completed successfully Jul 09 14:20:33 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17" returned: 0 in 0.698s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] Lock "cinder-quobyte-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17" released by "delete_volume" :: held 1.549s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:33 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] Created reservations ['748e95a2-9793-4030-b226-e79ccb520afa', '2bd5183d-fe96-423d-8e6f-60e29d78b1ac', 'e19cfa46-9dda-4206-a9bb-f724b9bf6f44', '553ceedf-1df7-4f9a-a5f4-8b44c2332caf'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:20:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:20:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:20:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:33 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:20:33 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:33 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487 1073741824" returned: 0 in 0.885s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:33 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=85,cinder:INSERT=30,cinder:UPDATE=115,cinder:DELETE=5 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:20:33 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=82,cinder:INSERT=21,cinder:UPDATE=98,cinder:DELETE=13 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:20:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:33 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487 Jul 09 14:20:33 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7fcf1018-2467-44a4-9c62-811e843fcba0 tempest-VolumesSnapshotListTestJSON-1315121760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] Acquiring lock "cinder-f26ce8eb-7cf9-4e8f-98d6-178254b703f8-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] Lock "cinder-f26ce8eb-7cf9-4e8f-98d6-178254b703f8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] Acquiring lock "cinder-quobyte-f26ce8eb-7cf9-4e8f-98d6-178254b703f8" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] Lock "cinder-quobyte-f26ce8eb-7cf9-4e8f-98d6-178254b703f8" acquired by "delete_volume" :: waited 0.033s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb42f583-c89f-4807-a219-d933a34858ff]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:34 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 Jul 09 14:20:34 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:34 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.877s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:20:34 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] Deleted volume successfully. Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5af5db2c-c82e-481b-93cd-a71da9e7f740 tempest-VolumesGetTest-2050916066 None] Lock "cinder-662b2c50-df9d-4c41-8e8d-2a4ef98e3f17-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:34 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487" returned: 0 in 0.863s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7fcf1018-2467-44a4-9c62-811e843fcba0 tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.790s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-7fcf1018-2467-44a4-9c62-811e843fcba0 tempest-VolumesSnapshotListTestJSON-1315121760 None] Creating offline snapshot 33d5b03c-151a-4c52-bf39-e8d9d1e68c8a of volume bc0e387b-89ef-4a1e-b1a1-5d12873987f7 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba40018-1e20-4682-b40a-1f1442fbb787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7809650e-fb81-4bfe-8568-afed3484c6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bc40e0-25ec-42b0-a493-a2df714f111b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7fcf1018-2467-44a4-9c62-811e843fcba0 tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:34 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Volume volume-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487 (3469a1a0-0b09-49eb-ad74-ed1c7ec6b487): created successfully Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7809650e-fb81-4bfe-8568-afed3484c6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Flow 'volume_create_manager' (a594028a-8283-49ea-b0b7-7368b2eeaae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:20:34 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-1089fe38-8509-46a8-979e-3efcfdc9a4a7 tempest-VolumesTransfersV357Test-674530222 None] Created volume successfully. Jul 09 14:20:34 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f Jul 09 14:20:34 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:35 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8" returned: 0 in 0.843s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:35 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8 Jul 09 14:20:35 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:35 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7fcf1018-2467-44a4-9c62-811e843fcba0 tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f" returned: 0 in 0.924s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-7fcf1018-2467-44a4-9c62-811e843fcba0 tempest-VolumesSnapshotListTestJSON-1315121760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:20:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7fcf1018-2467-44a4-9c62-811e843fcba0 tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:35 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a 1G Jul 09 14:20:35 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:36 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f26ce8eb-7cf9-4e8f-98d6-178254b703f8" returned: 0 in 0.933s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] Lock "cinder-quobyte-f26ce8eb-7cf9-4e8f-98d6-178254b703f8" released by "delete_volume" :: held 1.863s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:36 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-083b0e78-b31a-40d9-b197-fcd6f62e65ec tempest-VolumesTransfersV357Test-1766498721 None] Transfer volume completed successfully. Jul 09 14:20:36 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] Created reservations ['6c621892-c557-49b5-98e0-eb3aaad377aa', '78ccb6ef-f638-4f9c-adc0-dde67d1df0a7', '58cd1699-0fd4-4ea9-9001-ee599ee999b7', '9004a9ca-a7d7-4fc0-95ff-4685567ebf3c'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:20:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:20:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:20:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:36 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:20:36 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:36 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7fcf1018-2467-44a4-9c62-811e843fcba0 tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a 1G" returned: 0 in 1.233s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7fcf1018-2467-44a4-9c62-811e843fcba0 tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:36 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a Jul 09 14:20:36 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] Acquiring lock "cinder-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] Lock "cinder-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] Acquiring lock "cinder-quobyte-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] Lock "cinder-quobyte-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487" acquired by "delete_volume" :: waited 0.029s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:37 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.113s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Flow 'volume_create_manager' (3f2636cf-8995-4195-8a90-487c1051161c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890db3eb-c465-4ed3-ac3f-db08589a6640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[2965bc25-3bc9-40de-bc8c-4b575b85871d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:37 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] Deleted volume successfully. Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890db3eb-c465-4ed3-ac3f-db08589a6640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-570099707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea08230-77af-4344-ab4a-6244325bb2c6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7ab174ab408473198772e75b2be704f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:20:37Z,use_quota=True,user_id='94d5c506fc0a42b3b57cbf3909b4cdb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c611f180-09ea-4075-969d-1b1f1732cffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c611f180-09ea-4075-969d-1b1f1732cffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99fbab3e-bb66-4f21-89d3-d9d436688276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.image.glance [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Creating Keystone auth plugin from conf {{(pid=87011) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b191949f-a498-4d19-86cc-c15377d1bf47 tempest-VolumesGetTest-2050916066 None] Lock "cinder-f26ce8eb-7cf9-4e8f-98d6-178254b703f8-delete_volume" released by "delete_volume" :: held 3.354s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:37 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487 Jul 09 14:20:37 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99fbab3e-bb66-4f21-89d3-d9d436688276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ea08230-77af-4344-ab4a-6244325bb2c6', 'volume_name': 'volume-4ea08230-77af-4344-ab4a-6244325bb2c6', 'volume_size': 1, 'image_id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c87c562978df4c18bad93b074708151d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'created_at': datetime.datetime(2026, 7, 9, 12, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fed42dad-a967-43d7-aa04-dfd40efa81d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fa2b9f-f00a-4da1-80d1-2aa88cfff75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fa2b9f-f00a-4da1-80d1-2aa88cfff75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:37 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ebf761-b587-4193-9fa6-77442abf3f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:37 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Volume 4ea08230-77af-4344-ab4a-6244325bb2c6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ea08230-77af-4344-ab4a-6244325bb2c6', 'volume_size': 1, 'image_id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c87c562978df4c18bad93b074708151d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'created_at': datetime.datetime(2026, 7, 9, 12, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fed42dad-a967-43d7-aa04-dfd40efa81d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Trying to clone 4ea08230-77af-4344-ab4a-6244325bb2c6 from image fed42dad-a967-43d7-aa04-dfd40efa81d3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}]). {{(pid=87011) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7fcf1018-2467-44a4-9c62-811e843fcba0 tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a" returned: 0 in 1.101s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:37 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-7fcf1018-2467-44a4-9c62-811e843fcba0 tempest-VolumesSnapshotListTestJSON-1315121760 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a is being set with open permissions: ugo+rw Jul 09 14:20:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7fcf1018-2467-44a4-9c62-811e843fcba0 tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:37 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a Jul 09 14:20:37 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:38 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_h4jp36b1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 14:20:38 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Image download 20.69 MB at 20.69 MB/s Jul 09 14:20:38 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487" returned: 0 in 0.952s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:38 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a90dc8-c22b-4713-9282-810fc93c4d8e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_h4jp36b1devstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:38 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487 Jul 09 14:20:38 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:38 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_h4jp36b1devstack@QuobyteHD Jul 09 14:20:38 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:38 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7fcf1018-2467-44a4-9c62-811e843fcba0 tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a" returned: 0 in 0.942s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7fcf1018-2467-44a4-9c62-811e843fcba0 tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.342s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:38 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:20:38 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-7fcf1018-2467-44a4-9c62-811e843fcba0 tempest-VolumesSnapshotListTestJSON-1315121760 None] Create snapshot completed successfully Jul 09 14:20:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Flow 'volume_create_manager' (4622e5bd-1c41-494a-824a-f04c17b95024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:20:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247339e2-c834-442b-8211-efff26046532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247339e2-c834-442b-8211-efff26046532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1381669667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8d4af57a1044bc8da3d66b8d76aa46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2444418e-efa1-4e50-abaa-031fc43d90cf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:20:39Z,use_quota=True,user_id='bab14b8e1a98439ab4ecb7ad584044b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a5f2aa-de39-461c-8bfe-d6b90c1c6b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a5f2aa-de39-461c-8bfe-d6b90c1c6b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b5de26-f896-4e2a-8a85-6746c9deb316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b5de26-f896-4e2a-8a85-6746c9deb316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7', 'volume_name': 'volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7', 'volume_size': 1, 'snapshot_id': '2444418e-efa1-4e50-abaa-031fc43d90cf'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60ef32e-d8a1-410f-b4ad-18a49ed22ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60ef32e-d8a1-410f-b4ad-18a49ed22ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df1d1f7e-3248-4d95-872e-bca3aa6b36ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:39 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Volume bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7', 'volume_size': 1, 'snapshot_id': '2444418e-efa1-4e50-abaa-031fc43d90cf'} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Acquiring lock "cinder-quobyte-2444418e-efa1-4e50-abaa-031fc43d90cf-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7" by "_create_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Lock "cinder-quobyte-2444418e-efa1-4e50-abaa-031fc43d90cf-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Creating volume bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7 from snapshot 2444418e-efa1-4e50-abaa-031fc43d90cf {{(pid=87011) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Acquiring lock "cinder-quobyte-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7" by "_copy_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Lock "cinder-quobyte-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] snapshot: 2444418e-efa1-4e50-abaa-031fc43d90cf, volume: bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7, {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8d72c8-c897-4ad7-ab58-ebe59a153c0f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:39 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487" returned: 0 in 0.867s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] Lock "cinder-quobyte-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487" released by "delete_volume" :: held 1.898s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] Created reservations ['582c8444-0fd7-4912-8101-e953b79b061d', '3bbbcf55-d82d-40bc-a2a1-aee4740ae62e', '0212d9ac-c24a-4188-bb6c-36ff4d039ac5', '10c591fa-3db0-4594-b893-9083c7358f3d'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:20:39 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_h4jp36b1devstack@QuobyteHD" returned: 0 in 1.031s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Temporary image fed42dad-a967-43d7-aa04-dfd40efa81d3 is fetched for user 94d5c506fc0a42b3b57cbf3909b4cdb4. {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 14:20:39 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf Jul 09 14:20:39 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5551d052-e111-49df-8ac5-aebc3fc6027c tempest-VolumesSnapshotListTestJSON-1315121760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:39 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:20:39 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cc2582-a9a4-4711-8eaf-c4d0abb4c520]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_h4jp36b1devstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:39 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_h4jp36b1devstack@QuobyteHD Jul 09 14:20:39 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:20:40 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Flow 'volume_create_manager' (25e43f82-5af2-4f85-ae93-ccd19776d8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4935785-a5d2-4220-bdde-9d6525b075e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf" returned: 0 in 1.227s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Creating direct copy from snapshot {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c51f98b-4e34-4fb0-80a2-b19c17fb5991]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4935785-a5d2-4220-bdde-9d6525b075e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1171947011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310ab395-ae09-4e87-9617-5edcc1c84a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846dd70d81014425a574e04386cdac1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:20:40Z,use_quota=True,user_id='fa96546fbb394e8e85b7537db0471507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b86610-22f8-4a51-acbf-9405f6dc4a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b86610-22f8-4a51-acbf-9405f6dc4a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf0b88b-bfca-4ce5-a13f-3c5b79b49178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf0b88b-bfca-4ce5-a13f-3c5b79b49178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '310ab395-ae09-4e87-9617-5edcc1c84a9b', 'volume_name': 'volume-310ab395-ae09-4e87-9617-5edcc1c84a9b', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e83edc38-b7dd-4239-aea1-69ac6a124cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e83edc38-b7dd-4239-aea1-69ac6a124cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99aab57-9f52-49ca-8fe3-c75e9d0d0e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:40 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Volume 310ab395-ae09-4e87-9617-5edcc1c84a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-310ab395-ae09-4e87-9617-5edcc1c84a9b', 'volume_size': 1} Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:40 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.060s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:20:40 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] Deleted volume successfully. Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-839acb1f-8d7f-410b-9708-ace9d958fcb6 tempest-VolumesTransfersV357Test-2057927192 None] Lock "cinder-3469a1a0-0b09-49eb-ad74-ed1c7ec6b487-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:40 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_h4jp36b1devstack@QuobyteHD" returned: 0 in 1.090s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:40 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c Jul 09 14:20:40 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:41 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c" returned: 0 in 0.820s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:41 devstack cinder-volume[87011]: DEBUG cinder.utils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Path /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7 not found in is_blk_device check {{(pid=87011) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 14:20:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:41 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7 Jul 09 14:20:41 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:46 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7" returned: 0 in 4.834s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:46 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9aef4d7-466c-4503-978e-92853bae6fe8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:46 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c Jul 09 14:20:46 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:47 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c" returned: 0 in 1.099s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:47 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c, size 1024.00 MB, duration 4.83 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7 {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:20:47 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Converted 1024.00 MB image at 211.80 MB/s Jul 09 14:20:47 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7 is being set with open permissions: ugo+rw Jul 09 14:20:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:47 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7 Jul 09 14:20:47 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:48 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7" returned: 0 in 0.880s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Lock "cinder-quobyte-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7" released by "_copy_volume_from_snapshot" :: held 9.068s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Lock "cinder-quobyte-2444418e-efa1-4e50-abaa-031fc43d90cf-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7" released by "_create_volume_from_snapshot" :: held 9.109s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.136s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5551d052-e111-49df-8ac5-aebc3fc6027c tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.744s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-5551d052-e111-49df-8ac5-aebc3fc6027c tempest-VolumesSnapshotListTestJSON-1315121760 None] Creating offline snapshot d93c3eee-2750-4581-ad39-5fb625745e85 of volume bc0e387b-89ef-4a1e-b1a1-5d12873987f7 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:20:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df1d1f7e-3248-4d95-872e-bca3aa6b36ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7', 'volume_size': 1, 'snapshot_id': '2444418e-efa1-4e50-abaa-031fc43d90cf'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2e5fae-db51-4776-bc18-6fb150d28590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:48 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f239be55-5dd6-4923-ab92-f752c71ba96d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5551d052-e111-49df-8ac5-aebc3fc6027c tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:48 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Volume volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7 (bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7): created successfully Jul 09 14:20:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2e5fae-db51-4776-bc18-6fb150d28590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Flow 'volume_create_manager' (4622e5bd-1c41-494a-824a-f04c17b95024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:20:48 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-3e96911c-96b8-4e02-99bc-b34c2d0b41b3 tempest-TestStampPattern-426171458 None] Created volume successfully. Jul 09 14:20:48 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a Jul 09 14:20:48 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:49 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5551d052-e111-49df-8ac5-aebc3fc6027c tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a" returned: 0 in 0.827s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:49 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-5551d052-e111-49df-8ac5-aebc3fc6027c tempest-VolumesSnapshotListTestJSON-1315121760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:20:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5551d052-e111-49df-8ac5-aebc3fc6027c tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:49 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85 1G Jul 09 14:20:49 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:50 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5551d052-e111-49df-8ac5-aebc3fc6027c tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85 1G" returned: 0 in 0.930s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5551d052-e111-49df-8ac5-aebc3fc6027c tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:50 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85 Jul 09 14:20:50 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:50 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5551d052-e111-49df-8ac5-aebc3fc6027c tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85" returned: 0 in 0.679s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:50 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-5551d052-e111-49df-8ac5-aebc3fc6027c tempest-VolumesSnapshotListTestJSON-1315121760 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85 is being set with open permissions: ugo+rw Jul 09 14:20:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5551d052-e111-49df-8ac5-aebc3fc6027c tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:50 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85 Jul 09 14:20:50 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:51 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5551d052-e111-49df-8ac5-aebc3fc6027c tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85" returned: 0 in 0.792s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5551d052-e111-49df-8ac5-aebc3fc6027c tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.373s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.062s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1171947011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310ab395-ae09-4e87-9617-5edcc1c84a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='846dd70d81014425a574e04386cdac1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:20:40Z,use_quota=True,user_id='fa96546fbb394e8e85b7537db0471507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:20:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Creating volume 310ab395-ae09-4e87-9617-5edcc1c84a9b {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:20:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:20:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:20:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:20:51 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:20:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-310ab395-ae09-4e87-9617-5edcc1c84a9b 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:51 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-310ab395-ae09-4e87-9617-5edcc1c84a9b 1073741824 Jul 09 14:20:51 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:51 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-5551d052-e111-49df-8ac5-aebc3fc6027c tempest-VolumesSnapshotListTestJSON-1315121760 None] Create snapshot completed successfully Jul 09 14:20:52 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-310ab395-ae09-4e87-9617-5edcc1c84a9b 1073741824" returned: 0 in 0.883s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-310ab395-ae09-4e87-9617-5edcc1c84a9b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:52 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-310ab395-ae09-4e87-9617-5edcc1c84a9b Jul 09 14:20:52 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] Acquiring lock "cinder-d93c3eee-2750-4581-ad39-5fb625745e85-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-d93c3eee-2750-4581-ad39-5fb625745e85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] Acquiring lock "cinder-quobyte-bc0e387b-89ef-4a1e-b1a1-5d12873987f7" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-quobyte-bc0e387b-89ef-4a1e-b1a1-5d12873987f7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] Acquiring lock "cinder-quobyte-d93c3eee-2750-4581-ad39-5fb625745e85" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-quobyte-d93c3eee-2750-4581-ad39-5fb625745e85" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] Deleting offline snapshot d93c3eee-2750-4581-ad39-5fb625745e85 of volume bc0e387b-89ef-4a1e-b1a1-5d12873987f7 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:20:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] snapshot_file for this snap is: volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:20:52 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc172bd-7a70-4e31-9e6d-6004c15811b6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:53 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85 Jul 09 14:20:53 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:53 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-310ab395-ae09-4e87-9617-5edcc1c84a9b" returned: 0 in 0.782s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.718s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-570099707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea08230-77af-4344-ab4a-6244325bb2c6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a7ab174ab408473198772e75b2be704f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:20:37Z,use_quota=True,user_id='94d5c506fc0a42b3b57cbf3909b4cdb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Creating volume 4ea08230-77af-4344-ab4a-6244325bb2c6 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:20:53 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99aab57-9f52-49ca-8fe3-c75e9d0d0e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-310ab395-ae09-4e87-9617-5edcc1c84a9b', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb056971-787b-4c3a-a8de-582267569a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:20:53 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 1073741824 Jul 09 14:20:53 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:53 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Volume volume-310ab395-ae09-4e87-9617-5edcc1c84a9b (310ab395-ae09-4e87-9617-5edcc1c84a9b): created successfully Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb056971-787b-4c3a-a8de-582267569a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Flow 'volume_create_manager' (25e43f82-5af2-4f85-ae93-ccd19776d8a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:20:53 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-23d6fe1c-cc3b-4882-8e84-6976a300cac4 tempest-VolumesTransfersV357Test-674530222 None] Created volume successfully. Jul 09 14:20:53 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85" returned: 0 in 0.849s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0c4d7e-0843-4856-b392-9c9706a75419]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:54 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a Jul 09 14:20:54 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:54 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 1073741824" returned: 0 in 0.928s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:54 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 Jul 09 14:20:54 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] Acquiring lock "cinder-310ab395-ae09-4e87-9617-5edcc1c84a9b-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] Lock "cinder-310ab395-ae09-4e87-9617-5edcc1c84a9b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] Acquiring lock "cinder-quobyte-310ab395-ae09-4e87-9617-5edcc1c84a9b" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] Lock "cinder-quobyte-310ab395-ae09-4e87-9617-5edcc1c84a9b" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:55 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[419f8716-cc60-4708-a844-f5fc9ea7b6d5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-310ab395-ae09-4e87-9617-5edcc1c84a9b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:55 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a" returned: 0 in 1.225s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:20:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:55 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85 Jul 09 14:20:55 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:55 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-310ab395-ae09-4e87-9617-5edcc1c84a9b Jul 09 14:20:55 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:55 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6" returned: 0 in 0.901s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:20:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:55 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Attempting download of fed42dad-a967-43d7-aa04-dfd40efa81d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}])) to volume 4ea08230-77af-4344-ab4a-6244325bb2c6. {{(pid=87011) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 14:20:55 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eeffa67-8191-4dff-ab28-6fcee7dc0d63]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_vntv89uh {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:55 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_vntv89uh Jul 09 14:20:55 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:56 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-310ab395-ae09-4e87-9617-5edcc1c84a9b" returned: 0 in 1.211s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-310ab395-ae09-4e87-9617-5edcc1c84a9b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:56 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-310ab395-ae09-4e87-9617-5edcc1c84a9b Jul 09 14:20:56 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:56 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85" returned: 0 in 1.421s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:56 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85 Jul 09 14:20:56 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:56 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_vntv89uh" returned: 0 in 1.402s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_vntv89uh {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:57 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_vntv89uh Jul 09 14:20:57 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:57 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-310ab395-ae09-4e87-9617-5edcc1c84a9b" returned: 0 in 1.044s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] Lock "cinder-quobyte-310ab395-ae09-4e87-9617-5edcc1c84a9b" released by "delete_volume" :: held 2.313s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:57 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.d93c3eee-2750-4581-ad39-5fb625745e85" returned: 0 in 0.873s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-quobyte-d93c3eee-2750-4581-ad39-5fb625745e85" released by "_delete_snapshot" :: held 4.536s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-quobyte-bc0e387b-89ef-4a1e-b1a1-5d12873987f7" released by "delete_snapshot" :: held 4.585s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:57 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] Created reservations ['bab85b65-4479-45e8-8715-ce4f8376f4bd', 'd07fa217-5455-4bf0-a7b8-84577a38011d', 'b7e769b6-2fdf-47bc-9255-b3201367a085', 'c251cb67-842f-4b52-8194-4fe0a3f18ed0'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:20:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:20:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:20:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:20:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:20:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:20:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:57 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] Created reservations ['6b190069-b541-4843-ba91-6b25388ef133', '809dd063-509a-43ff-a02f-183a787d5aad', '67a9ec44-c7b4-4dff-b16a-442be2a62e74', '5a5f8846-a7a2-47a4-9419-f1465fb45e05'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:20:57 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:20:57 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:57 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] Delete snapshot completed successfully. Jul 09 14:20:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6af7daa3-26e3-473a-8a34-b0f397c8a4c9 tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-d93c3eee-2750-4581-ad39-5fb625745e85-delete_snapshot" released by "delete_snapshot" :: held 5.068s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:58 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_vntv89uh" returned: 1 in 1.180s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_vntv89uh' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:20:58 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[3033d7bd-1217-4751-814a-76f8e38a5a6d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_h4jp36b1devstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:58 devstack sudo[99600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_h4jp36b1devstack@QuobyteHD Jul 09 14:20:58 devstack sudo[99600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] Acquiring lock "cinder-33d5b03c-151a-4c52-bf39-e8d9d1e68c8a-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-33d5b03c-151a-4c52-bf39-e8d9d1e68c8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] Acquiring lock "cinder-quobyte-bc0e387b-89ef-4a1e-b1a1-5d12873987f7" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-quobyte-bc0e387b-89ef-4a1e-b1a1-5d12873987f7" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] Acquiring lock "cinder-quobyte-33d5b03c-151a-4c52-bf39-e8d9d1e68c8a" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:20:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-quobyte-33d5b03c-151a-4c52-bf39-e8d9d1e68c8a" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:20:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] Deleting offline snapshot 33d5b03c-151a-4c52-bf39-e8d9d1e68c8a of volume bc0e387b-89ef-4a1e-b1a1-5d12873987f7 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:20:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] snapshot_file for this snap is: volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:20:58 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[60651295-12c0-42b0-88f6-53c3393a9cd3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:20:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:58 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.046s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:58 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:20:58 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] Deleted volume successfully. Jul 09 14:20:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f7eee93d-ad12-4ea1-8a38-2e19251c5550 tempest-VolumesTransfersV357Test-2057927192 None] Lock "cinder-310ab395-ae09-4e87-9617-5edcc1c84a9b-delete_volume" released by "delete_volume" :: held 3.949s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:20:58 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a Jul 09 14:20:58 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:20:59 devstack sudo[99600]: pam_unix(sudo:session): session closed for user root Jul 09 14:20:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_h4jp36b1devstack@QuobyteHD" returned: 0 in 1.050s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:20:59 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] fed42dad-a967-43d7-aa04-dfd40efa81d3 was qcow2, converting to raw {{(pid=87011) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 14:20:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_h4jp36b1devstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:20:59 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_h4jp36b1devstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 Jul 09 14:20:59 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:00 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a" returned: 0 in 1.319s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:21:00 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12798a9-419a-4c62-b718-f8a783f9ab54]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:00 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f Jul 09 14:21:00 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:01 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f" returned: 0 in 1.265s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:01 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:21:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:01 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a Jul 09 14:21:01 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:02 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_h4jp36b1devstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6" returned: 0 in 2.879s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:02 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_h4jp36b1devstack@QuobyteHD, size 112.00 MB, duration 2.88 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:21:02 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Converted 112.00 MB image at 38.88 MB/s Jul 09 14:21:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:02 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 1G Jul 09 14:21:02 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:02 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a" returned: 0 in 1.281s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:02 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a Jul 09 14:21:02 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:02 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 1G" returned: 0 in 0.888s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:02 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[9153cf6e-cd26-48ff-ae68-0b9ba14d4c10]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:03 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 Jul 09 14:21:03 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:03 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.33d5b03c-151a-4c52-bf39-e8d9d1e68c8a" returned: 0 in 0.833s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-quobyte-33d5b03c-151a-4c52-bf39-e8d9d1e68c8a" released by "_delete_snapshot" :: held 4.922s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-quobyte-bc0e387b-89ef-4a1e-b1a1-5d12873987f7" released by "delete_snapshot" :: held 4.980s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:03 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] Created reservations ['8afe48fc-548f-42fa-8b56-5e05be0e31ef', 'd07bdbab-dad3-443d-91f9-1a25ce9447ad', '469e5847-34c7-4858-a2a1-f60c36c15e74', '6b3e7c8b-6434-458c-8a66-3c95cbf12073'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:21:03 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] Delete snapshot completed successfully. Jul 09 14:21:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-43e3ebd7-6daa-4616-8b86-447dcee8705b tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-33d5b03c-151a-4c52-bf39-e8d9d1e68c8a-delete_snapshot" released by "delete_snapshot" :: held 5.377s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:04 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6" returned: 0 in 1.138s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:04 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 Jul 09 14:21:04 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] Acquiring lock "cinder-550cc676-5423-47e6-a8d8-5a3dfeb0ce5f-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-550cc676-5423-47e6-a8d8-5a3dfeb0ce5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] Acquiring lock "cinder-quobyte-bc0e387b-89ef-4a1e-b1a1-5d12873987f7" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-quobyte-bc0e387b-89ef-4a1e-b1a1-5d12873987f7" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] Acquiring lock "cinder-quobyte-550cc676-5423-47e6-a8d8-5a3dfeb0ce5f" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-quobyte-550cc676-5423-47e6-a8d8-5a3dfeb0ce5f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] Deleting offline snapshot 550cc676-5423-47e6-a8d8-5a3dfeb0ce5f of volume bc0e387b-89ef-4a1e-b1a1-5d12873987f7 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:21:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] snapshot_file for this snap is: volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:21:05 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8b32a8-d1c4-450b-a576-0fc7699cd7fa]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:05 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6" returned: 1 in 0.916s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:21:05 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Downloaded image fed42dad-a967-43d7-aa04-dfd40efa81d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}])) to volume 4ea08230-77af-4344-ab4a-6244325bb2c6 successfully. {{(pid=87011) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 14:21:05 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Temporary image fed42dad-a967-43d7-aa04-dfd40efa81d3 for user 94d5c506fc0a42b3b57cbf3909b4cdb4 is deleted. {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 14:21:05 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Marking volume 4ea08230-77af-4344-ab4a-6244325bb2c6 as bootable. {{(pid=87011) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 14:21:05 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Copying metadata from image fed42dad-a967-43d7-aa04-dfd40efa81d3 to 4ea08230-77af-4344-ab4a-6244325bb2c6. {{(pid=87011) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 14:21:05 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Creating volume glance metadata for volume 4ea08230-77af-4344-ab4a-6244325bb2c6 backed by image fed42dad-a967-43d7-aa04-dfd40efa81d3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87011) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 14:21:05 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f Jul 09 14:21:05 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ebf761-b587-4193-9fa6-77442abf3f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ea08230-77af-4344-ab4a-6244325bb2c6', 'volume_size': 1, 'image_id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c87c562978df4c18bad93b074708151d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'created_at': datetime.datetime(2026, 7, 9, 12, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fed42dad-a967-43d7-aa04-dfd40efa81d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafd1743-37ea-41fc-a675-fb364be5898a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:05 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Volume volume-4ea08230-77af-4344-ab4a-6244325bb2c6 (4ea08230-77af-4344-ab4a-6244325bb2c6): created successfully Jul 09 14:21:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafd1743-37ea-41fc-a675-fb364be5898a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Flow 'volume_create_manager' (3f2636cf-8995-4195-8a90-487c1051161c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:21:05 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-22247116-1f7f-479c-9c04-841972c0cec9 tempest-VolumesGetTest-2050916066 None] Created volume successfully. Jul 09 14:21:05 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f" returned: 0 in 0.962s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:21:06 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5836e51c-afaf-4fa0-bdf4-cb12f3668a0b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:06 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7 Jul 09 14:21:06 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:06 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7" returned: 0 in 0.843s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:06 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f Jul 09 14:21:06 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Flow 'volume_create_manager' (59161060-cc34-4f6a-8838-0da874e3a079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee3fb30-a430-41ef-b236-79ca9e89e153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee3fb30-a430-41ef-b236-79ca9e89e153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:21:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2061265178',display_name='tempest-VolumesGetTest-Volume-270094024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2f7689-749f-448b-87fe-023f9ed04a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ab174ab408473198772e75b2be704f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:21:07Z,use_quota=True,user_id='94d5c506fc0a42b3b57cbf3909b4cdb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c365ae3-116c-4433-8489-64cfb0db0abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c365ae3-116c-4433-8489-64cfb0db0abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab34226-15d4-4104-9dd1-f0246278d8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab34226-15d4-4104-9dd1-f0246278d8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de2f7689-749f-448b-87fe-023f9ed04a2a', 'volume_name': 'volume-de2f7689-749f-448b-87fe-023f9ed04a2a', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af94f991-52fa-466a-8c5d-9af4a375396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af94f991-52fa-466a-8c5d-9af4a375396b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed2d340-3a4f-44c3-adec-50f2576e510a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:07 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Volume de2f7689-749f-448b-87fe-023f9ed04a2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de2f7689-749f-448b-87fe-023f9ed04a2a', 'volume_size': 1} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:21:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2061265178',display_name='tempest-VolumesGetTest-Volume-270094024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2f7689-749f-448b-87fe-023f9ed04a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ab174ab408473198772e75b2be704f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:21:07Z,use_quota=True,user_id='94d5c506fc0a42b3b57cbf3909b4cdb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Creating volume de2f7689-749f-448b-87fe-023f9ed04a2a {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:21:07 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-de2f7689-749f-448b-87fe-023f9ed04a2a 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:21:07 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-de2f7689-749f-448b-87fe-023f9ed04a2a 1073741824 Jul 09 14:21:07 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Flow 'volume_create_manager' (6ae513c8-88b1-4c37-9327-001ce7f96cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6908d3-83d7-4af5-8ab4-a2cbc47ef129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6908d3-83d7-4af5-8ab4-a2cbc47ef129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1851827059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e70e609-b562-458b-9dea-9c0ddaa27746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033c4008ddd94d7bb1421e30f33e4d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:21:07Z,use_quota=True,user_id='8ee1688fd18549b3bb6e76398dcef64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774d0d06-a03b-4640-9561-8b8b8149e3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774d0d06-a03b-4640-9561-8b8b8149e3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a437b0cb-c934-46df-be1d-7747d9e7d496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a437b0cb-c934-46df-be1d-7747d9e7d496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e70e609-b562-458b-9dea-9c0ddaa27746', 'volume_name': 'volume-6e70e609-b562-458b-9dea-9c0ddaa27746', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8da7ca-8db2-4dc8-af93-16b3fd3124a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8da7ca-8db2-4dc8-af93-16b3fd3124a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05bf25f-af94-4c19-bc02-52a9c53f16db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:07 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Volume 6e70e609-b562-458b-9dea-9c0ddaa27746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e70e609-b562-458b-9dea-9c0ddaa27746', 'volume_size': 1} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:07 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f" returned: 0 in 0.715s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:07 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f Jul 09 14:21:07 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:08 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7.550cc676-5423-47e6-a8d8-5a3dfeb0ce5f" returned: 0 in 0.680s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:08 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-de2f7689-749f-448b-87fe-023f9ed04a2a 1073741824" returned: 0 in 1.058s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:08 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-quobyte-550cc676-5423-47e6-a8d8-5a3dfeb0ce5f" released by "_delete_snapshot" :: held 3.361s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:08 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-quobyte-bc0e387b-89ef-4a1e-b1a1-5d12873987f7" released by "delete_snapshot" :: held 3.401s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-de2f7689-749f-448b-87fe-023f9ed04a2a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:08 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-de2f7689-749f-448b-87fe-023f9ed04a2a Jul 09 14:21:08 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:08 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] Created reservations ['3153d862-8874-4032-8529-f6c82ca4d06e', '257565f8-5ba0-4387-bfd6-ed2903b318a0', 'd3ae095a-fa4c-4af2-bf21-c6125c6332c1', 'd2ef87be-25de-4ed8-bfad-dcaac919094e'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:21:08 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] Delete snapshot completed successfully. Jul 09 14:21:08 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0211f35e-9591-4681-bfb9-48f5c5e6c28a tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-550cc676-5423-47e6-a8d8-5a3dfeb0ce5f-delete_snapshot" released by "delete_snapshot" :: held 3.592s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:09 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-de2f7689-749f-448b-87fe-023f9ed04a2a" returned: 0 in 0.725s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.727s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1851827059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e70e609-b562-458b-9dea-9c0ddaa27746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033c4008ddd94d7bb1421e30f33e4d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:21:07Z,use_quota=True,user_id='8ee1688fd18549b3bb6e76398dcef64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Creating volume 6e70e609-b562-458b-9dea-9c0ddaa27746 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:21:09 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:09 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 1073741824 Jul 09 14:21:09 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed2d340-3a4f-44c3-adec-50f2576e510a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de2f7689-749f-448b-87fe-023f9ed04a2a', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c45ef7a-615c-4fd1-9474-d3efe1de8f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:09 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Volume volume-de2f7689-749f-448b-87fe-023f9ed04a2a (de2f7689-749f-448b-87fe-023f9ed04a2a): created successfully Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c45ef7a-615c-4fd1-9474-d3efe1de8f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Flow 'volume_create_manager' (59161060-cc34-4f6a-8838-0da874e3a079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:21:09 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b9ec2c56-f1f9-4b41-a8fb-c3c7bcd6b8f8 tempest-VolumesGetTest-2050916066 None] Created volume successfully. Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] Acquiring lock "cinder-bc0e387b-89ef-4a1e-b1a1-5d12873987f7-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-bc0e387b-89ef-4a1e-b1a1-5d12873987f7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] Acquiring lock "cinder-quobyte-bc0e387b-89ef-4a1e-b1a1-5d12873987f7" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-quobyte-bc0e387b-89ef-4a1e-b1a1-5d12873987f7" acquired by "delete_volume" :: waited 0.014s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[8984b0fc-308a-422d-9546-68031d4180d8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:09 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7 Jul 09 14:21:09 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:09 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 1073741824" returned: 0 in 0.861s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:10 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 Jul 09 14:21:10 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] Acquiring lock "cinder-de2f7689-749f-448b-87fe-023f9ed04a2a-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] Lock "cinder-de2f7689-749f-448b-87fe-023f9ed04a2a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:10 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7" returned: 0 in 0.899s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:10 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7 Jul 09 14:21:10 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] Acquiring lock "cinder-quobyte-de2f7689-749f-448b-87fe-023f9ed04a2a" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] Lock "cinder-quobyte-de2f7689-749f-448b-87fe-023f9ed04a2a" acquired by "delete_volume" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:10 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4ca823-c51d-4455-843b-785fb0204ff2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-de2f7689-749f-448b-87fe-023f9ed04a2a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:10 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-de2f7689-749f-448b-87fe-023f9ed04a2a Jul 09 14:21:10 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:10 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746" returned: 0 in 0.798s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:21:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05bf25f-af94-4c19-bc02-52a9c53f16db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e70e609-b562-458b-9dea-9c0ddaa27746', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a8150c-44a1-47ed-ba22-652721044699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:10 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Volume volume-6e70e609-b562-458b-9dea-9c0ddaa27746 (6e70e609-b562-458b-9dea-9c0ddaa27746): created successfully Jul 09 14:21:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a8150c-44a1-47ed-ba22-652721044699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Flow 'volume_create_manager' (6ae513c8-88b1-4c37-9327-001ce7f96cfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:21:10 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-aa5e914a-6f75-40fb-b117-88efccc2388b tempest-VolumesCloneTest-983997361 None] Created volume successfully. Jul 09 14:21:10 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc0e387b-89ef-4a1e-b1a1-5d12873987f7" returned: 0 in 0.711s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-quobyte-bc0e387b-89ef-4a1e-b1a1-5d12873987f7" released by "delete_volume" :: held 1.672s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] Created reservations ['889943db-dc5b-492b-9bdb-a89f1969b1f8', '520754d2-50b9-4c7a-8e56-1123c05d24fa', '9dd843d2-18d0-4cb5-8d9a-fe9b0103ca17', '65d5fdd6-c44d-4a6f-b621-6a589eaa2088'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:11 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:21:11 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:11 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-de2f7689-749f-448b-87fe-023f9ed04a2a" returned: 0 in 0.821s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-de2f7689-749f-448b-87fe-023f9ed04a2a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:11 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-de2f7689-749f-448b-87fe-023f9ed04a2a Jul 09 14:21:11 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:11 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.731s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:21:11 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] Deleted volume successfully. Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6d740717-cee1-4b04-9d0e-35bd15316efb tempest-VolumesSnapshotListTestJSON-1315121760 None] Lock "cinder-bc0e387b-89ef-4a1e-b1a1-5d12873987f7-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Flow 'volume_create_manager' (8e9580b1-aa30-4674-9c52-89a6940b2b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20aee654-fce2-4bdc-83d0-43019dd85b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20aee654-fce2-4bdc-83d0-43019dd85b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-543344633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2c9377-8128-4f6c-bc5c-64c876b69fef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='033c4008ddd94d7bb1421e30f33e4d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:21:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6e70e609-b562-458b-9dea-9c0ddaa27746,status='creating',terminated_at=None,updated_at=2026-07-09T12:21:12Z,use_quota=True,user_id='8ee1688fd18549b3bb6e76398dcef64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1040d60e-5b04-4ad9-8ca6-70f31d017f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1040d60e-5b04-4ad9-8ca6-70f31d017f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40dd5b9-6c11-4b4b-b5a6-dbe5d09bedf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40dd5b9-6c11-4b4b-b5a6-dbe5d09bedf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3d2c9377-8128-4f6c-bc5c-64c876b69fef', 'volume_name': 'volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef', 'volume_size': 2, 'source_volid': '6e70e609-b562-458b-9dea-9c0ddaa27746', 'source_volstatus': 'available'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6744157-bd47-44ed-96fc-7bc54dadb5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6744157-bd47-44ed-96fc-7bc54dadb5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d366c234-83f6-4453-961d-acbfa4a73230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:11 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Volume 3d2c9377-8128-4f6c-bc5c-64c876b69fef: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef', 'volume_size': 2, 'source_volid': '6e70e609-b562-458b-9dea-9c0ddaa27746', 'source_volstatus': 'available'} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:12 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Cloning volume 6e70e609-b562-458b-9dea-9c0ddaa27746 to volume 3d2c9377-8128-4f6c-bc5c-64c876b69fef Jul 09 14:21:12 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-de2f7689-749f-448b-87fe-023f9ed04a2a" returned: 0 in 0.860s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] Lock "cinder-quobyte-de2f7689-749f-448b-87fe-023f9ed04a2a" released by "delete_volume" :: held 1.741s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Creating offline snapshot ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e of volume 6e70e609-b562-458b-9dea-9c0ddaa27746 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0559d3-4bc7-45c5-93bf-aff45e036ba0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] Created reservations ['7b4c3ee2-4a87-4013-851c-d12ccbd674fb', '53ab6fc0-5f57-4ffb-8441-58d6414d4867', 'a0798305-4e36-4b18-890e-1a64b2a854b8', '60aac180-c3fc-4878-bd0d-ce975a05c389'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:12 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 Jul 09 14:21:12 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:12 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:21:12 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:12 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:21:12 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] Acquiring lock "cinder-4ea08230-77af-4344-ab4a-6244325bb2c6-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] Lock "cinder-4ea08230-77af-4344-ab4a-6244325bb2c6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] Acquiring lock "cinder-quobyte-4ea08230-77af-4344-ab4a-6244325bb2c6" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] Lock "cinder-quobyte-4ea08230-77af-4344-ab4a-6244325bb2c6" acquired by "delete_volume" :: waited 0.034s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d777b3-2ac9-4f3a-9a8a-fb87e1c8fcf9]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:13 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 Jul 09 14:21:13 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:13 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746" returned: 0 in 1.110s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:13 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.024s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:21:13 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e 1G Jul 09 14:21:13 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:13 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] Deleted volume successfully. Jul 09 14:21:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ca6c70c7-95a5-47b5-a8c3-53fc5435811d tempest-VolumesGetTest-2050916066 None] Lock "cinder-de2f7689-749f-448b-87fe-023f9ed04a2a-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:13 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.871s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:21:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:21:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:21:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:21:13 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6" returned: 0 in 1.010s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:14 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 Jul 09 14:21:14 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:14 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e 1G" returned: 0 in 0.958s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e70e609-b562-458b-9dea-9c0ddaa27746 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:14 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e70e609-b562-458b-9dea-9c0ddaa27746 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e Jul 09 14:21:14 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:14 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6" returned: 1 in 0.792s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:21:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:14 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6 Jul 09 14:21:14 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:14 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e70e609-b562-458b-9dea-9c0ddaa27746 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e" returned: 0 in 0.792s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:14 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e is being set with open permissions: ugo+rw Jul 09 14:21:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:14 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e Jul 09 14:21:14 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:15 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4ea08230-77af-4344-ab4a-6244325bb2c6" returned: 0 in 0.782s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:15 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] Lock "cinder-quobyte-4ea08230-77af-4344-ab4a-6244325bb2c6" released by "delete_volume" :: held 2.676s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:15 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] Created reservations ['e75902ae-71f6-4611-8039-e9ff2060f256', '5dc7cf8c-2464-4013-b7f6-67f9e2ca14e2', '3ec16fd7-51f7-480b-80a2-35e27d20cb58', '350bbd12-8cb4-4e69-8b8d-f0ebbfddf2a4'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:21:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:21:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:21:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:15 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e" returned: 0 in 0.783s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:15 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:21:15 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:15 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.info Jul 09 14:21:15 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:16 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.761s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:16 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:21:16 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] Deleted volume successfully. Jul 09 14:21:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c67b56f5-a23b-4eb9-8d62-5233c3bf4d24 tempest-VolumesGetTest-2050916066 None] Lock "cinder-4ea08230-77af-4344-ab4a-6244325bb2c6-delete_volume" released by "delete_volume" :: held 3.825s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:16 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.info" returned: 0 in 0.828s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:16 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.info is being set with open permissions: ugo+rw Jul 09 14:21:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:16 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.info Jul 09 14:21:16 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:17 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.info" returned: 0 in 0.744s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Acquiring lock "cinder-quobyte-3d2c9377-8128-4f6c-bc5c-64c876b69fef" by "_copy_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Lock "cinder-quobyte-3d2c9377-8128-4f6c-bc5c-64c876b69fef" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] snapshot: ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e, volume: 3d2c9377-8128-4f6c-bc5c-64c876b69fef, {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 14:21:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:21:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:21:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:17 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71b963b-7207-4e19-a25c-fa161e1f3512]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:17 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e Jul 09 14:21:17 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:18 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e" returned: 0 in 0.939s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e70e609-b562-458b-9dea-9c0ddaa27746(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:21:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 14:21:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Creating direct copy from snapshot {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 14:21:18 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4b69c2-7155-4526-bca7-729036802881]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:18 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 Jul 09 14:21:18 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:19 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746" returned: 0 in 1.041s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:19 devstack cinder-volume[87011]: DEBUG cinder.utils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Path /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef not found in is_blk_device check {{(pid=87011) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 14:21:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:19 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef Jul 09 14:21:19 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:20 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:21:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Flow 'volume_create_manager' (9a044d83-b720-40f3-8df1-0d3c26608e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:21:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5f9455-2f5b-4eb3-90c6-357a134585ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5f9455-2f5b-4eb3-90c6-357a134585ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-367647326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ee8966-ed74-4b8e-a822-336455e1de65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0003406da854f2a951959e6eebab987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:21:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:21:20Z,use_quota=True,user_id='1a8b87dd729b46a7a91360c7b4afd1a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfab3e5-557b-4db4-8536-26d4d6439231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfab3e5-557b-4db4-8536-26d4d6439231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0043e9a4-9e7b-4079-95bd-014c5ffc4bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0043e9a4-9e7b-4079-95bd-014c5ffc4bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ee8966-ed74-4b8e-a822-336455e1de65', 'volume_name': 'volume-63ee8966-ed74-4b8e-a822-336455e1de65', 'volume_size': 2}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d95d59-4b6c-4c26-83b9-4814e385c2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d95d59-4b6c-4c26-83b9-4814e385c2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81861e48-1409-4443-8da1-2787a79e6751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:20 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Volume 63ee8966-ed74-4b8e-a822-336455e1de65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ee8966-ed74-4b8e-a822-336455e1de65', 'volume_size': 2} Jul 09 14:21:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-437ed3b8-5fc5-4721-ada2-4d05748e201f req-cc79ba31-dfa7-4900-b955-4a214c7a9379 tempest-TestStampPattern-426171458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:25 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef" returned: 0 in 5.868s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:25 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e1f999-e328-40cf-abc7-dbd13022b6c0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:25 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 Jul 09 14:21:25 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:26 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746" returned: 0 in 0.975s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:26 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:21:26 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Converted 1024.00 MB image at 174.48 MB/s Jul 09 14:21:26 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef is being set with open permissions: ugo+rw Jul 09 14:21:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:26 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef Jul 09 14:21:26 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:26 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef" returned: 0 in 0.640s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Lock "cinder-quobyte-3d2c9377-8128-4f6c-bc5c-64c876b69fef" released by "_copy_volume_from_snapshot" :: held 9.564s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Acquiring lock "cinder-quobyte-ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Lock "cinder-quobyte-ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Deleting offline snapshot ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e of volume 6e70e609-b562-458b-9dea-9c0ddaa27746 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:21:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] snapshot_file for this snap is: volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:21:27 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[08be7acd-0b16-4896-ac92-c436e2e4d797]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:27 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e Jul 09 14:21:27 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:27 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e" returned: 0 in 0.898s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:27 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e70e609-b562-458b-9dea-9c0ddaa27746(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:21:27 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbf0721-2bb2-4a06-b4b3-002f1649ea45]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:28 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 Jul 09 14:21:28 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:28 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746" returned: 0 in 0.743s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:28 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e Jul 09 14:21:28 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:29 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e" returned: 0 in 0.734s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:29 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e Jul 09 14:21:29 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:30 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746.ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e" returned: 0 in 0.690s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Lock "cinder-quobyte-ea6e11e7-c4eb-42c5-8dc3-00bf11bc872e" released by "_delete_snapshot" :: held 3.176s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.186s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.588s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-367647326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ee8966-ed74-4b8e-a822-336455e1de65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0003406da854f2a951959e6eebab987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:21:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:21:20Z,use_quota=True,user_id='1a8b87dd729b46a7a91360c7b4afd1a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Creating volume 63ee8966-ed74-4b8e-a822-336455e1de65 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:21:30 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65 2147483648 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:30 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65 2147483648 Jul 09 14:21:30 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d366c234-83f6-4453-961d-acbfa4a73230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef', 'volume_size': 2, 'source_volid': '6e70e609-b562-458b-9dea-9c0ddaa27746', 'source_volstatus': 'available'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b138303a-bda7-4abb-a0b5-1fd5a948ba1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:30 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Volume volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef (3d2c9377-8128-4f6c-bc5c-64c876b69fef): created successfully Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b138303a-bda7-4abb-a0b5-1fd5a948ba1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Flow 'volume_create_manager' (8e9580b1-aa30-4674-9c52-89a6940b2b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:21:30 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-5c9b3d56-4b73-44f7-82d2-d124ccc275fd tempest-VolumesCloneTest-983997361 None] Created volume successfully. Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] Acquiring lock "cinder-3d2c9377-8128-4f6c-bc5c-64c876b69fef-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] Lock "cinder-3d2c9377-8128-4f6c-bc5c-64c876b69fef-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] Acquiring lock "cinder-quobyte-3d2c9377-8128-4f6c-bc5c-64c876b69fef" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] Lock "cinder-quobyte-3d2c9377-8128-4f6c-bc5c-64c876b69fef" acquired by "delete_volume" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f864c2-7fbe-4312-af91-027d21f2d440]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:30 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef Jul 09 14:21:30 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:31 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65 2147483648" returned: 0 in 1.004s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:31 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65 Jul 09 14:21:31 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:31 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef" returned: 0 in 0.822s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:31 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef Jul 09 14:21:31 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:31 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65" returned: 0 in 0.676s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:21:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-437ed3b8-5fc5-4721-ada2-4d05748e201f req-cc79ba31-dfa7-4900-b955-4a214c7a9379 tempest-TestStampPattern-426171458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.743s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81861e48-1409-4443-8da1-2787a79e6751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ee8966-ed74-4b8e-a822-336455e1de65', 'volume_size': 2}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887dbc0f-7cd0-471e-bf4c-57f0d28b57e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:31 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[be135ecd-34ca-4be8-9c2e-bdf871381c4a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-437ed3b8-5fc5-4721-ada2-4d05748e201f req-cc79ba31-dfa7-4900-b955-4a214c7a9379 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:31 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Volume volume-63ee8966-ed74-4b8e-a822-336455e1de65 (63ee8966-ed74-4b8e-a822-336455e1de65): created successfully Jul 09 14:21:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887dbc0f-7cd0-471e-bf4c-57f0d28b57e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Flow 'volume_create_manager' (9a044d83-b720-40f3-8df1-0d3c26608e09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:21:32 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-db6c12e5-13b6-44e7-ac3f-14860ced2d1d tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Created volume successfully. Jul 09 14:21:32 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7 Jul 09 14:21:32 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:32 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3d2c9377-8128-4f6c-bc5c-64c876b69fef" returned: 0 in 0.789s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] Lock "cinder-quobyte-3d2c9377-8128-4f6c-bc5c-64c876b69fef" released by "delete_volume" :: held 1.671s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:32 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] Created reservations ['34a7ff77-31c0-415b-bcbc-f473be5ff048', 'e3066afc-2da2-4b2a-a092-407fe51d76c8', 'c651cfc9-699b-40a8-bdc0-f97370154133', 'cc8fde05-916b-47bc-a265-796f118406fa'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:21:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:21:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:21:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:32 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:21:32 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:32 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-437ed3b8-5fc5-4721-ada2-4d05748e201f req-cc79ba31-dfa7-4900-b955-4a214c7a9379 tempest-TestStampPattern-426171458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7" returned: 0 in 0.912s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-437ed3b8-5fc5-4721-ada2-4d05748e201f req-cc79ba31-dfa7-4900-b955-4a214c7a9379 tempest-TestStampPattern-426171458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.949s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.361s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Creating offline snapshot d82a9267-e9c7-40ff-9767-42571f5855ba of volume 63ee8966-ed74-4b8e-a822-336455e1de65 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:21:32 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[d023c700-0ab8-4552-ac7c-2b2da0b38200]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-437ed3b8-5fc5-4721-ada2-4d05748e201f req-cc79ba31-dfa7-4900-b955-4a214c7a9379 tempest-TestStampPattern-426171458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '839ed3e6-292d-47d5-9345-4fec46e7c857', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:21:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] Acquiring lock "cinder-6e70e609-b562-458b-9dea-9c0ddaa27746-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] Lock "cinder-6e70e609-b562-458b-9dea-9c0ddaa27746-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:33 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65 Jul 09 14:21:33 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:33 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-437ed3b8-5fc5-4721-ada2-4d05748e201f req-cc79ba31-dfa7-4900-b955-4a214c7a9379 tempest-TestStampPattern-426171458 None] attachment_update completed successfully. Jul 09 14:21:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] Acquiring lock "cinder-quobyte-6e70e609-b562-458b-9dea-9c0ddaa27746" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] Lock "cinder-quobyte-6e70e609-b562-458b-9dea-9c0ddaa27746" acquired by "delete_volume" :: waited 0.046s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:33 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c16e39-d00e-4471-b139-8009f7bc42a7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:33 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.717s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:33 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:21:33 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] Deleted volume successfully. Jul 09 14:21:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-10fc8dae-2d93-48fc-bff2-30197fef847e tempest-VolumesCloneTest-983997361 None] Lock "cinder-3d2c9377-8128-4f6c-bc5c-64c876b69fef-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:33 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 Jul 09 14:21:33 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:34 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746" returned: 0 in 0.929s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:34 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65" returned: 0 in 1.285s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba 2G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:34 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746 Jul 09 14:21:34 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:34 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba 2G Jul 09 14:21:34 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:35 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e70e609-b562-458b-9dea-9c0ddaa27746" returned: 0 in 0.944s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] Lock "cinder-quobyte-6e70e609-b562-458b-9dea-9c0ddaa27746" released by "delete_volume" :: held 1.960s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:35 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=92,cinder:INSERT=27,cinder:UPDATE=93,cinder:DELETE=11 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:21:35 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=87,cinder:UPDATE=112,cinder:DELETE=7,cinder:INSERT=35 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:21:35 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] Created reservations ['6f3df988-6471-41a5-80c2-9e26959e3309', '1065f318-806a-4aef-a71b-372f8c7029fe', '9a5c8723-261f-48e0-9823-b857b144ac35', '9272d634-9c62-48e3-b529-9510dc52c037'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:21:35 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba 2G" returned: 0 in 1.094s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ee8966-ed74-4b8e-a822-336455e1de65 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:35 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ee8966-ed74-4b8e-a822-336455e1de65 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba Jul 09 14:21:35 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:21:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:21:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:35 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:21:35 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:36 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.815s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:36 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:21:36 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] Deleted volume successfully. Jul 09 14:21:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ba897dbc-708c-48a0-a0d0-fae57134960f tempest-VolumesCloneTest-983997361 None] Lock "cinder-6e70e609-b562-458b-9dea-9c0ddaa27746-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:36 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63ee8966-ed74-4b8e-a822-336455e1de65 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba" returned: 0 in 0.991s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:36 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba is being set with open permissions: ugo+rw Jul 09 14:21:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:36 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba Jul 09 14:21:36 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:37 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba" returned: 0 in 0.818s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:37 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.info Jul 09 14:21:37 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:38 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.info" returned: 0 in 0.882s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:38 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.info is being set with open permissions: ugo+rw Jul 09 14:21:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:38 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.info Jul 09 14:21:38 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:38 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.info" returned: 0 in 0.849s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.059s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:38 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-3e7fa6bc-5cff-4777-add6-7e1141066920 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Create snapshot completed successfully Jul 09 14:21:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Acquiring lock "cinder-d82a9267-e9c7-40ff-9767-42571f5855ba-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Lock "cinder-d82a9267-e9c7-40ff-9767-42571f5855ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Acquiring lock "cinder-quobyte-63ee8966-ed74-4b8e-a822-336455e1de65" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Lock "cinder-quobyte-63ee8966-ed74-4b8e-a822-336455e1de65" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Acquiring lock "cinder-quobyte-d82a9267-e9c7-40ff-9767-42571f5855ba" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Lock "cinder-quobyte-d82a9267-e9c7-40ff-9767-42571f5855ba" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Deleting offline snapshot d82a9267-e9c7-40ff-9767-42571f5855ba of volume 63ee8966-ed74-4b8e-a822-336455e1de65 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:21:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] snapshot_file for this snap is: volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:21:40 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9753f16-e069-4c46-a2fb-92b05e72f13f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:40 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba Jul 09 14:21:40 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:40 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-c1fd4666-5f19-4c3f-a42b-014144572347 req-3300fc3a-eef9-411a-8499-5d40239262ba tempest-TestStampPattern-426171458 None] Terminate volume connection completed successfully. Jul 09 14:21:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-c1fd4666-5f19-4c3f-a42b-014144572347 req-3300fc3a-eef9-411a-8499-5d40239262ba tempest-TestStampPattern-426171458 None] Deleting attachment 839ed3e6-292d-47d5-9345-4fec46e7c857. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:21:41 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba" returned: 0 in 0.889s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63ee8966-ed74-4b8e-a822-336455e1de65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:21:41 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[954332dc-2c53-4e7d-808a-53ae42582080]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:41 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65 Jul 09 14:21:41 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:42 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65" returned: 0 in 0.865s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:42 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba Jul 09 14:21:42 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:42 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba" returned: 0 in 0.953s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:43 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba Jul 09 14:21:43 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:43 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:43 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:21:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Flow 'volume_create_manager' (23f1348c-1f49-4507-90f3-ea9a0a8c75eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:21:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5878fc11-14ce-4d6b-9a04-43892bc9a4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:43 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:21:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Flow 'volume_create_manager' (957343ab-a5aa-4475-919f-c456e4b4f848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:21:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0553b9-4e6b-4549-9f47-ed2ba6c3d092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65.d82a9267-e9c7-40ff-9767-42571f5855ba" returned: 0 in 0.969s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0553b9-4e6b-4549-9f47-ed2ba6c3d092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1975216217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7930e22d-d441-43d2-b6f8-66e2d64b282e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77459f5eec5b45a9a85f7eaba1f75bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:21:44Z,use_quota=True,user_id='f64374be3f2e488f816ef78bc4096a81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50ffab8d-a8a7-4df0-ada0-8edba85d155e),volume_type_id=50ffab8d-a8a7-4df0-ada0-8edba85d155e)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669c0e1d-65a7-46ce-9afe-3b915745860a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669c0e1d-65a7-46ce-9afe-3b915745860a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ab3539-56f4-422a-b882-d1d87813ff8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ab3539-56f4-422a-b882-d1d87813ff8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7930e22d-d441-43d2-b6f8-66e2d64b282e', 'volume_name': 'volume-7930e22d-d441-43d2-b6f8-66e2d64b282e', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a438f766-aa3f-4d76-bf79-302eec1e92fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a438f766-aa3f-4d76-bf79-302eec1e92fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18bf60a-c609-46bd-a268-c86b1c95a1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:44 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Volume 7930e22d-d441-43d2-b6f8-66e2d64b282e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7930e22d-d441-43d2-b6f8-66e2d64b282e', 'volume_size': 1} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1975216217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7930e22d-d441-43d2-b6f8-66e2d64b282e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77459f5eec5b45a9a85f7eaba1f75bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:21:44Z,use_quota=True,user_id='f64374be3f2e488f816ef78bc4096a81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50ffab8d-a8a7-4df0-ada0-8edba85d155e),volume_type_id=50ffab8d-a8a7-4df0-ada0-8edba85d155e)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Creating volume 7930e22d-d441-43d2-b6f8-66e2d64b282e {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:21:44 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7930e22d-d441-43d2-b6f8-66e2d64b282e 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5878fc11-14ce-4d6b-9a04-43892bc9a4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-834410633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c32deef-3770-45ce-9629-2822c2f99556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ef8c9927d9460db2a0628b26334b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:21:44Z,use_quota=True,user_id='cb668dd16945428db4f1351234bbfba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e50d6ea-e684-44d6-97d2-3e5779416eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e50d6ea-e684-44d6-97d2-3e5779416eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1999ec2a-e7d6-4271-8682-cad0cd22de3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1999ec2a-e7d6-4271-8682-cad0cd22de3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c32deef-3770-45ce-9629-2822c2f99556', 'volume_name': 'volume-1c32deef-3770-45ce-9629-2822c2f99556', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:44 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7930e22d-d441-43d2-b6f8-66e2d64b282e 1073741824 Jul 09 14:21:44 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc3b811-2855-4bcc-a408-418d8b4d19eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc3b811-2855-4bcc-a408-418d8b4d19eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0041df-8085-408d-b8b1-ad979c78a333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:44 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Volume 1c32deef-3770-45ce-9629-2822c2f99556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c32deef-3770-45ce-9629-2822c2f99556', 'volume_size': 1} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Flow 'volume_create_manager' (7f1648b5-446a-42d3-bfd6-20931345304c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ec090f-32ab-4ef1-a18e-36dcc8ef7eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ec090f-32ab-4ef1-a18e-36dcc8ef7eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1423049016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e114037-7ee2-4d70-a71f-59553ad75a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77459f5eec5b45a9a85f7eaba1f75bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:21:44Z,use_quota=True,user_id='f64374be3f2e488f816ef78bc4096a81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee946aa2-e0d0-4841-836d-85f91acd420f),volume_type_id=ee946aa2-e0d0-4841-836d-85f91acd420f)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe76969-1686-4f84-92cd-3554a2dfadff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe76969-1686-4f84-92cd-3554a2dfadff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea962443-39ff-48c7-90d9-cc6155ae25bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea962443-39ff-48c7-90d9-cc6155ae25bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e114037-7ee2-4d70-a71f-59553ad75a3e', 'volume_name': 'volume-3e114037-7ee2-4d70-a71f-59553ad75a3e', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58bfe49b-0dd7-4348-bbb2-bb7ac5e055bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58bfe49b-0dd7-4348-bbb2-bb7ac5e055bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ef1af8-fb7a-46c0-b5fa-3cfaafd93b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:44 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Volume 3e114037-7ee2-4d70-a71f-59553ad75a3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e114037-7ee2-4d70-a71f-59553ad75a3e', 'volume_size': 1} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Lock "cinder-quobyte-d82a9267-e9c7-40ff-9767-42571f5855ba" released by "_delete_snapshot" :: held 4.349s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Lock "cinder-quobyte-63ee8966-ed74-4b8e-a822-336455e1de65" released by "delete_snapshot" :: held 4.398s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Created reservations ['2f245671-d1e2-4455-ae48-77737cc39b6a', '53f1d9e9-f9a4-4561-901b-f75113ed75da', '45964be7-975d-44dc-8476-d00d5ea2340c', '864b5852-5f82-4523-877f-4fb8c195a792'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:21:44 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Delete snapshot completed successfully. Jul 09 14:21:44 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-365810bf-93c6-4081-b506-7c96c8dc9867 tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Lock "cinder-d82a9267-e9c7-40ff-9767-42571f5855ba-delete_snapshot" released by "delete_snapshot" :: held 4.624s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Flow 'volume_create_manager' (dd74335e-2b7b-4311-8b78-3e4f93a1c654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e20217-3f1c-4c7f-97ba-3c9bcab57dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e20217-3f1c-4c7f-97ba-3c9bcab57dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1873819633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10087aa6-7d34-4da9-b7e8-afd70a21cf06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77459f5eec5b45a9a85f7eaba1f75bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:21:45Z,use_quota=True,user_id='f64374be3f2e488f816ef78bc4096a81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa05bcfc-7146-4ac2-8d68-691ad42e3b76),volume_type_id=aa05bcfc-7146-4ac2-8d68-691ad42e3b76)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9232d0da-fb66-432c-8c0d-b204fc45fc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9232d0da-fb66-432c-8c0d-b204fc45fc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcbc6b8e-52db-42af-930f-6d26060e49ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG cinder.image.glance [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Creating Keystone auth plugin from conf {{(pid=87011) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 14:21:45 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7930e22d-d441-43d2-b6f8-66e2d64b282e 1073741824" returned: 0 in 1.205s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcbc6b8e-52db-42af-930f-6d26060e49ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '10087aa6-7d34-4da9-b7e8-afd70a21cf06', 'volume_name': 'volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06', 'volume_size': 1, 'image_id': '303414b3-d82e-49b2-ae83-70ca389e5062', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/303414b3-d82e-49b2-ae83-70ca389e5062', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--78665288', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77459f5eec5b45a9a85f7eaba1f75bdb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '303414b3-d82e-49b2-ae83-70ca389e5062', 'created_at': datetime.datetime(2026, 7, 9, 12, 21, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 21, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/303414b3-d82e-49b2-ae83-70ca389e5062/file', 'properties': {}}, 'image_service': }' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb30836-6c73-44dc-abd5-7578ad864fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb30836-6c73-44dc-abd5-7578ad864fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515bfff9-c53a-4e14-a65e-82873e181b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:45 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Volume 10087aa6-7d34-4da9-b7e8-afd70a21cf06: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06', 'volume_size': 1, 'image_id': '303414b3-d82e-49b2-ae83-70ca389e5062', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/303414b3-d82e-49b2-ae83-70ca389e5062', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--78665288', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77459f5eec5b45a9a85f7eaba1f75bdb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '303414b3-d82e-49b2-ae83-70ca389e5062', 'created_at': datetime.datetime(2026, 7, 9, 12, 21, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 21, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/303414b3-d82e-49b2-ae83-70ca389e5062/file', 'properties': {}}, 'image_service': } Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Trying to clone 10087aa6-7d34-4da9-b7e8-afd70a21cf06 from image 303414b3-d82e-49b2-ae83-70ca389e5062 at location (None, [{'url': 'file:///opt/stack/data/glance/images/303414b3-d82e-49b2-ae83-70ca389e5062', 'metadata': {}}]). {{(pid=87011) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7930e22d-d441-43d2-b6f8-66e2d64b282e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:45 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7930e22d-d441-43d2-b6f8-66e2d64b282e Jul 09 14:21:45 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Acquiring lock "cinder-63ee8966-ed74-4b8e-a822-336455e1de65-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Lock "cinder-63ee8966-ed74-4b8e-a822-336455e1de65-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Acquiring lock "cinder-quobyte-63ee8966-ed74-4b8e-a822-336455e1de65" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Lock "cinder-quobyte-63ee8966-ed74-4b8e-a822-336455e1de65" acquired by "delete_volume" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d69bb87-6169-43b9-936f-48cb4938e352]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:46 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65 Jul 09 14:21:46 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:46 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7930e22d-d441-43d2-b6f8-66e2d64b282e" returned: 0 in 1.030s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] <== create_volume: return (2347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:21:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.351s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.225s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-834410633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c32deef-3770-45ce-9629-2822c2f99556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ef8c9927d9460db2a0628b26334b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:21:44Z,use_quota=True,user_id='cb668dd16945428db4f1351234bbfba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:21:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Creating volume 1c32deef-3770-45ce-9629-2822c2f99556 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:21:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:21:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:21:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:21:46 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:21:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1c32deef-3770-45ce-9629-2822c2f99556 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:46 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1c32deef-3770-45ce-9629-2822c2f99556 1073741824 Jul 09 14:21:46 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18bf60a-c609-46bd-a268-c86b1c95a1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7930e22d-d441-43d2-b6f8-66e2d64b282e', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b04aec-b2d3-4471-8186-f4b2474d9ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:46 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Volume volume-7930e22d-d441-43d2-b6f8-66e2d64b282e (7930e22d-d441-43d2-b6f8-66e2d64b282e): created successfully Jul 09 14:21:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b04aec-b2d3-4471-8186-f4b2474d9ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Flow 'volume_create_manager' (957343ab-a5aa-4475-919f-c456e4b4f848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:21:46 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d8b1ed15-0b49-4510-9c7c-41cd0bdf91a5 tempest-TestInstancesWithCinderVolumes-1834154807 None] Created volume successfully. Jul 09 14:21:47 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65" returned: 0 in 1.140s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:47 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65 Jul 09 14:21:47 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:47 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1c32deef-3770-45ce-9629-2822c2f99556 1073741824" returned: 0 in 1.083s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1c32deef-3770-45ce-9629-2822c2f99556 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:47 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1c32deef-3770-45ce-9629-2822c2f99556 Jul 09 14:21:47 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:47 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-63ee8966-ed74-4b8e-a822-336455e1de65" returned: 0 in 0.744s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Lock "cinder-quobyte-63ee8966-ed74-4b8e-a822-336455e1de65" released by "delete_volume" :: held 2.001s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:47 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Created reservations ['634aa7e5-8d49-47b6-9df2-6cbfc0a54bdf', 'fd0c607f-6b47-4b0b-9192-8e9a42892f0a', '471a5563-33bf-4fa7-ad18-b44ae89f1ef0', '63b847d0-bf7b-458c-a30a-078a662a7203'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:48 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:21:48 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:48 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1c32deef-3770-45ce-9629-2822c2f99556" returned: 0 in 0.868s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.998s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1423049016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e114037-7ee2-4d70-a71f-59553ad75a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77459f5eec5b45a9a85f7eaba1f75bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:21:44Z,use_quota=True,user_id='f64374be3f2e488f816ef78bc4096a81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee946aa2-e0d0-4841-836d-85f91acd420f),volume_type_id=ee946aa2-e0d0-4841-836d-85f91acd420f)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Creating volume 3e114037-7ee2-4d70-a71f-59553ad75a3e {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:21:48 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3e114037-7ee2-4d70-a71f-59553ad75a3e 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0041df-8085-408d-b8b1-ad979c78a333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c32deef-3770-45ce-9629-2822c2f99556', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:48 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3e114037-7ee2-4d70-a71f-59553ad75a3e 1073741824 Jul 09 14:21:48 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77353116-a503-453c-9ff3-3270bb31948c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:48 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Volume volume-1c32deef-3770-45ce-9629-2822c2f99556 (1c32deef-3770-45ce-9629-2822c2f99556): created successfully Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77353116-a503-453c-9ff3-3270bb31948c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Flow 'volume_create_manager' (23f1348c-1f49-4507-90f3-ea9a0a8c75eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:21:48 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-8b5a5f20-bd85-49d5-b0b5-faaeadd916d5 tempest-VolumesNegativeTest-1360221970 None] Created volume successfully. Jul 09 14:21:48 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.758s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:21:48 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Deleted volume successfully. Jul 09 14:21:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-51826611-59bd-4f2e-82dc-b713d5a7995c tempest-VolumesSnapshotNegativeTestJSON-2017556040 None] Lock "cinder-63ee8966-ed74-4b8e-a822-336455e1de65-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:49 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3e114037-7ee2-4d70-a71f-59553ad75a3e 1073741824" returned: 0 in 0.977s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3e114037-7ee2-4d70-a71f-59553ad75a3e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:49 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3e114037-7ee2-4d70-a71f-59553ad75a3e Jul 09 14:21:49 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:50 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_303414b3-d82e-49b2-ae83-70ca389e5062_gqmadfhodevstack@QuobyteHD, size 20.69 MB, duration 5.10 sec {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 14:21:50 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Image download 20.69 MB at 4.05 MB/s Jul 09 14:21:50 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3e114037-7ee2-4d70-a71f-59553ad75a3e" returned: 0 in 1.009s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:21:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ef1af8-fb7a-46c0-b5fa-3cfaafd93b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e114037-7ee2-4d70-a71f-59553ad75a3e', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a04a29-4dcf-4b06-be5b-2d5955667b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:21:50 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ce20c4-cafe-4958-bc5f-c269068bea2c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_303414b3-d82e-49b2-ae83-70ca389e5062_gqmadfhodevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:50 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Volume volume-3e114037-7ee2-4d70-a71f-59553ad75a3e (3e114037-7ee2-4d70-a71f-59553ad75a3e): created successfully Jul 09 14:21:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a04a29-4dcf-4b06-be5b-2d5955667b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:21:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Flow 'volume_create_manager' (7f1648b5-446a-42d3-bfd6-20931345304c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:21:50 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-e092cd42-0e57-48ae-ad6a-bb13e7885a2a tempest-TestInstancesWithCinderVolumes-1834154807 None] Created volume successfully. Jul 09 14:21:50 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_303414b3-d82e-49b2-ae83-70ca389e5062_gqmadfhodevstack@QuobyteHD Jul 09 14:21:50 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:51 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_303414b3-d82e-49b2-ae83-70ca389e5062_gqmadfhodevstack@QuobyteHD" returned: 0 in 0.820s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:51 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Temporary image 303414b3-d82e-49b2-ae83-70ca389e5062 is fetched for user f64374be3f2e488f816ef78bc4096a81. {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 14:21:51 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c90b2dd-634a-4188-939f-aa9a357b006f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_303414b3-d82e-49b2-ae83-70ca389e5062_gqmadfhodevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] Acquiring lock "cinder-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] Lock "cinder-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] Acquiring lock "cinder-quobyte-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] Lock "cinder-quobyte-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7" acquired by "delete_volume" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:51 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[a318d5a9-b55c-4b5d-a820-28e84e2b4ea2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:51 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_303414b3-d82e-49b2-ae83-70ca389e5062_gqmadfhodevstack@QuobyteHD Jul 09 14:21:51 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:51 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7 Jul 09 14:21:51 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:52 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_303414b3-d82e-49b2-ae83-70ca389e5062_gqmadfhodevstack@QuobyteHD" returned: 0 in 0.966s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1873819633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10087aa6-7d34-4da9-b7e8-afd70a21cf06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77459f5eec5b45a9a85f7eaba1f75bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:21:45Z,use_quota=True,user_id='f64374be3f2e488f816ef78bc4096a81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa05bcfc-7146-4ac2-8d68-691ad42e3b76),volume_type_id=aa05bcfc-7146-4ac2-8d68-691ad42e3b76)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:21:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Creating volume 10087aa6-7d34-4da9-b7e8-afd70a21cf06 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:21:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:21:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:21:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:21:52 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:21:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:52 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 1073741824 Jul 09 14:21:52 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:52 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7" returned: 0 in 1.045s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:52 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7 Jul 09 14:21:52 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:53 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7" returned: 0 in 0.764s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] Lock "cinder-quobyte-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7" released by "delete_volume" :: held 1.868s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:53 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] Created reservations ['ec6555df-2e09-4db5-ba63-489d7182d4c7', '0135258b-5147-45a8-ab7e-79a77d1522e5', 'a6491ddf-641b-4f0e-b90c-646cf7858d58', '7c207edc-72ae-44be-87e3-fabc8a506e6d'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:21:53 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 1073741824" returned: 0 in 1.174s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:53 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 Jul 09 14:21:53 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:21:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:21:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:21:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:21:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:53 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:21:53 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] Acquiring lock "cinder-2444418e-efa1-4e50-abaa-031fc43d90cf-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] Lock "cinder-2444418e-efa1-4e50-abaa-031fc43d90cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] Acquiring lock "cinder-quobyte-93fe0b7c-70b3-4f86-ba52-8018ead92b7c" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] Lock "cinder-quobyte-93fe0b7c-70b3-4f86-ba52-8018ead92b7c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] Acquiring lock "cinder-quobyte-2444418e-efa1-4e50-abaa-031fc43d90cf" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] Lock "cinder-quobyte-2444418e-efa1-4e50-abaa-031fc43d90cf" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] Deleting offline snapshot 2444418e-efa1-4e50-abaa-031fc43d90cf of volume 93fe0b7c-70b3-4f86-ba52-8018ead92b7c {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] snapshot_file for this snap is: volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[10871906-00d7-4c91-907b-01de6046493d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:54 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.809s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:21:54 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] Deleted volume successfully. Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3c6d2641-613f-4628-8f5b-525f6fab1cd0 tempest-TestStampPattern-426171458 None] Lock "cinder-bfb5b97d-6cc0-40d8-b8b5-44bc9fdf62b7-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:54 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06" returned: 0 in 1.005s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] <== create_volume: return (2237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.243s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:21:54 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf Jul 09 14:21:54 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Attempting download of 303414b3-d82e-49b2-ae83-70ca389e5062 ((None, [{'url': 'file:///opt/stack/data/glance/images/303414b3-d82e-49b2-ae83-70ca389e5062', 'metadata': {}}])) to volume 10087aa6-7d34-4da9-b7e8-afd70a21cf06. {{(pid=87011) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fdca6c-c0ed-48d8-8dfb-bf75a5b721a2]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_303414b3-d82e-49b2-ae83-70ca389e5062_vite7e24 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:54 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_303414b3-d82e-49b2-ae83-70ca389e5062_vite7e24 Jul 09 14:21:54 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:55 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf" returned: 0 in 0.952s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:21:55 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d60520-630f-4f01-97a9-e44f54f249f4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:55 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_303414b3-d82e-49b2-ae83-70ca389e5062_vite7e24" returned: 0 in 0.900s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_303414b3-d82e-49b2-ae83-70ca389e5062_vite7e24 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:55 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c Jul 09 14:21:55 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:55 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_303414b3-d82e-49b2-ae83-70ca389e5062_vite7e24 Jul 09 14:21:55 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:56 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c" returned: 0 in 1.183s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:56 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_303414b3-d82e-49b2-ae83-70ca389e5062_vite7e24" returned: 1 in 1.032s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_303414b3-d82e-49b2-ae83-70ca389e5062_vite7e24' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:21:56 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f335aba-f281-4132-89f4-ecdcbdb024dc]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:21:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_303414b3-d82e-49b2-ae83-70ca389e5062_gqmadfhodevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:56 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf Jul 09 14:21:56 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:56 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_303414b3-d82e-49b2-ae83-70ca389e5062_gqmadfhodevstack@QuobyteHD Jul 09 14:21:56 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:57 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf" returned: 0 in 1.127s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:57 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf Jul 09 14:21:57 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:57 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_303414b3-d82e-49b2-ae83-70ca389e5062_gqmadfhodevstack@QuobyteHD" returned: 0 in 1.217s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:58 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] 303414b3-d82e-49b2-ae83-70ca389e5062 was qcow2, converting to raw {{(pid=87011) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 14:21:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_303414b3-d82e-49b2-ae83-70ca389e5062_gqmadfhodevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:21:58 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_303414b3-d82e-49b2-ae83-70ca389e5062_gqmadfhodevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 Jul 09 14:21:58 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:21:58 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Jul 09 14:21:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c.2444418e-efa1-4e50-abaa-031fc43d90cf" returned: 0 in 1.090s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:21:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] Lock "cinder-quobyte-2444418e-efa1-4e50-abaa-031fc43d90cf" released by "_delete_snapshot" :: held 4.518s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] Lock "cinder-quobyte-93fe0b7c-70b3-4f86-ba52-8018ead92b7c" released by "delete_snapshot" :: held 4.558s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:21:59 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] Created reservations ['472493fb-ded8-480b-8f58-04bcd96557cd', '76d4222d-d6d6-42e9-b4c5-d911ff58ed36', '15753e32-d1a6-4ecf-85c9-1bdf41718175', 'f375808c-3ae9-4067-b4b8-40a2559279d0'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:21:59 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] Delete snapshot completed successfully. Jul 09 14:21:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-612d61a9-3d68-45c5-a392-6a8117cd6d91 tempest-TestStampPattern-426171458 None] Lock "cinder-2444418e-efa1-4e50-abaa-031fc43d90cf-delete_snapshot" released by "delete_snapshot" :: held 4.796s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Flow 'volume_create_manager' (e1715f8d-7137-41e0-87d6-c366f49c84b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef626b6-86ff-4936-b56e-1f17c179ff90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef626b6-86ff-4936-b56e-1f17c179ff90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-164618408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6038772c-2418-45e2-b8f2-8d93f5e0078a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830656ddff2f42aca9a1cd6d512473d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:22:01Z,use_quota=True,user_id='a35f24f4772a4b80817097dc53eb7f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338d55f2-6db4-41d4-8f53-8726e969adbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338d55f2-6db4-41d4-8f53-8726e969adbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e87cef-8e40-479d-afad-2b94bb84973d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e87cef-8e40-479d-afad-2b94bb84973d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6038772c-2418-45e2-b8f2-8d93f5e0078a', 'volume_name': 'volume-6038772c-2418-45e2-b8f2-8d93f5e0078a', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2231ff41-0999-4e16-aa30-65f3da93ff37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2231ff41-0999-4e16-aa30-65f3da93ff37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316f3ee7-f6d9-4195-89be-d1245977bd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:00 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Volume 6038772c-2418-45e2-b8f2-8d93f5e0078a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6038772c-2418-45e2-b8f2-8d93f5e0078a', 'volume_size': 1} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-164618408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6038772c-2418-45e2-b8f2-8d93f5e0078a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830656ddff2f42aca9a1cd6d512473d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:22:01Z,use_quota=True,user_id='a35f24f4772a4b80817097dc53eb7f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Creating volume 6038772c-2418-45e2-b8f2-8d93f5e0078a {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:22:00 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6038772c-2418-45e2-b8f2-8d93f5e0078a 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:00 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_303414b3-d82e-49b2-ae83-70ca389e5062_gqmadfhodevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06" returned: 0 in 2.864s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_303414b3-d82e-49b2-ae83-70ca389e5062_gqmadfhodevstack@QuobyteHD, size 112.00 MB, duration 2.87 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:22:00 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Converted 112.00 MB image at 39.07 MB/s Jul 09 14:22:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:00 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6038772c-2418-45e2-b8f2-8d93f5e0078a 1073741824 Jul 09 14:22:00 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:00 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 1G Jul 09 14:22:00 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:01 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 1G" returned: 0 in 0.915s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:01 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[79de6277-9970-45b9-9708-9bd0cb8b55ff]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:22:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:01 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 Jul 09 14:22:01 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:01 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6038772c-2418-45e2-b8f2-8d93f5e0078a 1073741824" returned: 0 in 1.138s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6038772c-2418-45e2-b8f2-8d93f5e0078a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:02 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6038772c-2418-45e2-b8f2-8d93f5e0078a Jul 09 14:22:02 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:02 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06" returned: 0 in 0.961s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:02 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6038772c-2418-45e2-b8f2-8d93f5e0078a" returned: 0 in 0.823s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:02 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:22:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316f3ee7-f6d9-4195-89be-d1245977bd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6038772c-2418-45e2-b8f2-8d93f5e0078a', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62796e00-ab74-448d-99c5-1e1236980118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:02 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Volume volume-6038772c-2418-45e2-b8f2-8d93f5e0078a (6038772c-2418-45e2-b8f2-8d93f5e0078a): created successfully Jul 09 14:22:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62796e00-ab74-448d-99c5-1e1236980118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Flow 'volume_create_manager' (e1715f8d-7137-41e0-87d6-c366f49c84b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:22:02 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 Jul 09 14:22:02 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-07dc7af4-b68c-437f-8f85-7eead3f68ada tempest-ProjectReaderTests-210099421 None] Created volume successfully. Jul 09 14:22:02 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:04 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06" returned: 1 in 1.349s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:22:04 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Downloaded image 303414b3-d82e-49b2-ae83-70ca389e5062 ((None, [{'url': 'file:///opt/stack/data/glance/images/303414b3-d82e-49b2-ae83-70ca389e5062', 'metadata': {}}])) to volume 10087aa6-7d34-4da9-b7e8-afd70a21cf06 successfully. {{(pid=87011) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 14:22:04 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Temporary image 303414b3-d82e-49b2-ae83-70ca389e5062 for user f64374be3f2e488f816ef78bc4096a81 is deleted. {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 14:22:04 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Marking volume 10087aa6-7d34-4da9-b7e8-afd70a21cf06 as bootable. {{(pid=87011) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 14:22:04 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Copying metadata from image 303414b3-d82e-49b2-ae83-70ca389e5062 to 10087aa6-7d34-4da9-b7e8-afd70a21cf06. {{(pid=87011) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 14:22:04 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Creating volume glance metadata for volume 10087aa6-7d34-4da9-b7e8-afd70a21cf06 backed by image 303414b3-d82e-49b2-ae83-70ca389e5062 with: {'image_id': '303414b3-d82e-49b2-ae83-70ca389e5062', 'image_name': 'tempest-scenario-img--78665288', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87011) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 14:22:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] Acquiring lock "cinder-6038772c-2418-45e2-b8f2-8d93f5e0078a-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:22:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] Lock "cinder-6038772c-2418-45e2-b8f2-8d93f5e0078a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:22:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (515bfff9-c53a-4e14-a65e-82873e181b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06', 'volume_size': 1, 'image_id': '303414b3-d82e-49b2-ae83-70ca389e5062', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/303414b3-d82e-49b2-ae83-70ca389e5062', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--78665288', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77459f5eec5b45a9a85f7eaba1f75bdb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '303414b3-d82e-49b2-ae83-70ca389e5062', 'created_at': datetime.datetime(2026, 7, 9, 12, 21, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 21, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/303414b3-d82e-49b2-ae83-70ca389e5062/file', 'properties': {}}, 'image_service': }' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffda1375-3bc9-4ce6-9631-74f1e2f0a6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] Acquiring lock "cinder-quobyte-6038772c-2418-45e2-b8f2-8d93f5e0078a" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:22:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] Lock "cinder-quobyte-6038772c-2418-45e2-b8f2-8d93f5e0078a" acquired by "delete_volume" :: waited 0.028s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:22:04 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Volume volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 (10087aa6-7d34-4da9-b7e8-afd70a21cf06): created successfully Jul 09 14:22:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffda1375-3bc9-4ce6-9631-74f1e2f0a6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Flow 'volume_create_manager' (dd74335e-2b7b-4311-8b78-3e4f93a1c654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:22:04 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-201babe4-6485-4459-b66a-f27f39ade49c tempest-TestInstancesWithCinderVolumes-1834154807 None] Created volume successfully. Jul 09 14:22:04 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64707ed-5cb4-4206-963a-95d55f36f872]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:22:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6038772c-2418-45e2-b8f2-8d93f5e0078a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:04 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6038772c-2418-45e2-b8f2-8d93f5e0078a Jul 09 14:22:04 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:05 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6038772c-2418-45e2-b8f2-8d93f5e0078a" returned: 0 in 1.160s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6038772c-2418-45e2-b8f2-8d93f5e0078a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:05 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6038772c-2418-45e2-b8f2-8d93f5e0078a Jul 09 14:22:05 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:06 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6038772c-2418-45e2-b8f2-8d93f5e0078a" returned: 0 in 0.886s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:06 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] Lock "cinder-quobyte-6038772c-2418-45e2-b8f2-8d93f5e0078a" released by "delete_volume" :: held 2.133s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:22:06 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] Created reservations ['1985fb47-db39-4765-8ce4-fcd9410ac392', 'da1f7b92-29b7-47e8-aeea-0bb70c1567e1', '10c8e3cf-01a1-4bf0-b8c2-614f15d3066e', '352d2c4b-3fde-40d9-b987-2f2ad39cdc6d'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:22:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:06 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:22:06 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:22:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:06 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:22:06 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:07 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.918s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:07 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:22:07 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] Deleted volume successfully. Jul 09 14:22:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d1908f4c-9ffb-4f50-8059-8ed717fafb3d tempest-ProjectReaderTests-210099421 None] Lock "cinder-6038772c-2418-45e2-b8f2-8d93f5e0078a-delete_volume" released by "delete_volume" :: held 3.509s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Flow 'volume_create_manager' (b3fda6a0-6bed-4b0f-aba9-23d13d90e79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40608fc0-7e05-4800-ae8a-c9005dc13c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40608fc0-7e05-4800-ae8a-c9005dc13c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1258851805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f668065d-e089-4eeb-9558-e309414c6688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830656ddff2f42aca9a1cd6d512473d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:22:08Z,use_quota=True,user_id='a35f24f4772a4b80817097dc53eb7f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f06cb66-3d6f-496e-a18c-a746c24ee38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f06cb66-3d6f-496e-a18c-a746c24ee38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb40445-49d3-42c6-b532-2a689575a9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb40445-49d3-42c6-b532-2a689575a9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f668065d-e089-4eeb-9558-e309414c6688', 'volume_name': 'volume-f668065d-e089-4eeb-9558-e309414c6688', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783dfe5d-0ddf-4fb1-ad1e-3934c2f7595d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783dfe5d-0ddf-4fb1-ad1e-3934c2f7595d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd1ea602-1c62-4019-81fc-59294d919407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:08 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Volume f668065d-e089-4eeb-9558-e309414c6688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f668065d-e089-4eeb-9558-e309414c6688', 'volume_size': 1} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1258851805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f668065d-e089-4eeb-9558-e309414c6688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830656ddff2f42aca9a1cd6d512473d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:22:08Z,use_quota=True,user_id='a35f24f4772a4b80817097dc53eb7f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Creating volume f668065d-e089-4eeb-9558-e309414c6688 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:22:08 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:22:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f668065d-e089-4eeb-9558-e309414c6688 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:08 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f668065d-e089-4eeb-9558-e309414c6688 1073741824 Jul 09 14:22:08 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:09 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] Acquiring lock "cinder-93fe0b7c-70b3-4f86-ba52-8018ead92b7c-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:22:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f668065d-e089-4eeb-9558-e309414c6688 1073741824" returned: 0 in 1.135s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] Lock "cinder-93fe0b7c-70b3-4f86-ba52-8018ead92b7c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:22:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f668065d-e089-4eeb-9558-e309414c6688 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:09 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f668065d-e089-4eeb-9558-e309414c6688 Jul 09 14:22:09 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] Acquiring lock "cinder-quobyte-93fe0b7c-70b3-4f86-ba52-8018ead92b7c" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:22:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] Lock "cinder-quobyte-93fe0b7c-70b3-4f86-ba52-8018ead92b7c" acquired by "delete_volume" :: waited 0.029s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:22:09 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3e0df6-5f2a-493a-9dd5-88ac3d12a676]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:22:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:09 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c Jul 09 14:22:09 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:10 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f668065d-e089-4eeb-9558-e309414c6688" returned: 0 in 0.787s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:22:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd1ea602-1c62-4019-81fc-59294d919407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f668065d-e089-4eeb-9558-e309414c6688', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0b3458-c844-4389-a3a2-96592eec6252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:10 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Volume volume-f668065d-e089-4eeb-9558-e309414c6688 (f668065d-e089-4eeb-9558-e309414c6688): created successfully Jul 09 14:22:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0b3458-c844-4389-a3a2-96592eec6252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Flow 'volume_create_manager' (b3fda6a0-6bed-4b0f-aba9-23d13d90e79b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:22:10 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-975944c7-7f34-46db-8d3d-570d71ccc6d7 tempest-ProjectReaderTests-210099421 None] Created volume successfully. Jul 09 14:22:10 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c" returned: 0 in 0.837s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:10 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c Jul 09 14:22:10 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:11 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-93fe0b7c-70b3-4f86-ba52-8018ead92b7c" returned: 0 in 0.846s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:11 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] Lock "cinder-quobyte-93fe0b7c-70b3-4f86-ba52-8018ead92b7c" released by "delete_volume" :: held 1.783s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:22:11 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] Acquiring lock "cinder-f668065d-e089-4eeb-9558-e309414c6688-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:22:11 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] Lock "cinder-f668065d-e089-4eeb-9558-e309414c6688-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:22:11 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] Acquiring lock "cinder-quobyte-f668065d-e089-4eeb-9558-e309414c6688" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:22:11 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] Created reservations ['6b46d744-aa5d-4a83-a336-8720c7db1fe9', 'ab088625-03a7-4dca-b48d-f20219e3791a', '51ea138d-a89b-4844-8858-2101efca9e1c', '93ccc895-1d3b-4d48-af43-032f47c3c30e'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:22:11 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] Lock "cinder-quobyte-f668065d-e089-4eeb-9558-e309414c6688" acquired by "delete_volume" :: waited 0.038s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:22:11 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a28b98c-f463-4ed4-b53e-f1e19d2b718e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:22:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f668065d-e089-4eeb-9558-e309414c6688 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:11 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:22:11 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:22:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:11 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:22:11 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:11 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f668065d-e089-4eeb-9558-e309414c6688 Jul 09 14:22:11 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:22:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:22:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:22:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:12 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:22:12 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:13 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.249s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:22:13 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] Deleted volume successfully. Jul 09 14:22:13 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f668065d-e089-4eeb-9558-e309414c6688" returned: 0 in 1.371s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f668065d-e089-4eeb-9558-e309414c6688 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:13 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f668065d-e089-4eeb-9558-e309414c6688 Jul 09 14:22:13 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-64476b94-e9ca-49d2-b15c-305e0f3d7faa tempest-TestStampPattern-426171458 None] Lock "cinder-93fe0b7c-70b3-4f86-ba52-8018ead92b7c-delete_volume" released by "delete_volume" :: held 3.616s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:22:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-d3ee8154-7c4f-4ed5-85f2-c54dfcc9976a req-e2696d18-7efc-445f-8c2e-527c30d0b075 tempest-TestInstancesWithCinderVolumes-1834154807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-d3ee8154-7c4f-4ed5-85f2-c54dfcc9976a req-e2696d18-7efc-445f-8c2e-527c30d0b075 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:13 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[4301edb8-ac6f-4ee7-a445-0d6da30bbd80]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:22:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-d3ee8154-7c4f-4ed5-85f2-c54dfcc9976a req-e2696d18-7efc-445f-8c2e-527c30d0b075 tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:13 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:13 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 Jul 09 14:22:13 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.136s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:22:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:22:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:22:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:22:14 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f668065d-e089-4eeb-9558-e309414c6688" returned: 0 in 1.053s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] Lock "cinder-quobyte-f668065d-e089-4eeb-9558-e309414c6688" released by "delete_volume" :: held 2.492s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:22:14 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] Created reservations ['09014adc-d115-41c1-a0f4-6373d9208e52', 'b3a90305-1c0e-49d1-8aec-e793ccde478c', '82bf0547-1236-47f7-959d-3b944acc5f70', 'fd8e6260-2f45-4655-af22-e5f0326b6d3a'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:22:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:22:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:22:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:14 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:22:14 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:14 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-d3ee8154-7c4f-4ed5-85f2-c54dfcc9976a req-e2696d18-7efc-445f-8c2e-527c30d0b075 tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06" returned: 0 in 1.095s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-d3ee8154-7c4f-4ed5-85f2-c54dfcc9976a req-e2696d18-7efc-445f-8c2e-527c30d0b075 tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:14 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 Jul 09 14:22:14 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:15 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.920s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:22:15 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] Deleted volume successfully. Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-aa22f837-3e26-4b21-bb7b-a2a98c536dbe tempest-ProjectReaderTests-210099421 None] Lock "cinder-f668065d-e089-4eeb-9558-e309414c6688-delete_volume" released by "delete_volume" :: held 3.738s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:22:15 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-d3ee8154-7c4f-4ed5-85f2-c54dfcc9976a req-e2696d18-7efc-445f-8c2e-527c30d0b075 tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06" returned: 1 in 1.095s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-d3ee8154-7c4f-4ed5-85f2-c54dfcc9976a req-e2696d18-7efc-445f-8c2e-527c30d0b075 tempest-TestInstancesWithCinderVolumes-1834154807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-d3ee8154-7c4f-4ed5-85f2-c54dfcc9976a req-e2696d18-7efc-445f-8c2e-527c30d0b075 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.298s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-d3ee8154-7c4f-4ed5-85f2-c54dfcc9976a req-e2696d18-7efc-445f-8c2e-527c30d0b075 tempest-TestInstancesWithCinderVolumes-1834154807 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '724d0922-ddc6-46eb-93e4-b4076ab003c4', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Flow 'volume_create_manager' (fc2a861a-c708-4168-9f23-5c0663b76535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7a3b1b-4d20-44df-938f-62007f7d5304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb7a3b1b-4d20-44df-938f-62007f7d5304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1097026401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a703522-9507-4f35-a058-f82d010180ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830656ddff2f42aca9a1cd6d512473d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:22:16Z,use_quota=True,user_id='a35f24f4772a4b80817097dc53eb7f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cb4e0d-dbf2-4df2-9bb1-f79a21e18939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cb4e0d-dbf2-4df2-9bb1-f79a21e18939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06277d8e-bc8d-484b-8505-93c5c3d33257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06277d8e-bc8d-484b-8505-93c5c3d33257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a703522-9507-4f35-a058-f82d010180ce', 'volume_name': 'volume-2a703522-9507-4f35-a058-f82d010180ce', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7a3cd8-adb0-4b67-af59-78e52d188eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7a3cd8-adb0-4b67-af59-78e52d188eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77b3976-70bc-46f9-b990-2b9b9ea3d12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:15 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Volume 2a703522-9507-4f35-a058-f82d010180ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a703522-9507-4f35-a058-f82d010180ce', 'volume_size': 1} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1097026401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a703522-9507-4f35-a058-f82d010180ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830656ddff2f42aca9a1cd6d512473d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:22:16Z,use_quota=True,user_id='a35f24f4772a4b80817097dc53eb7f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Creating volume 2a703522-9507-4f35-a058-f82d010180ce {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:22:15 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:22:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2a703522-9507-4f35-a058-f82d010180ce 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:15 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-d3ee8154-7c4f-4ed5-85f2-c54dfcc9976a req-e2696d18-7efc-445f-8c2e-527c30d0b075 tempest-TestInstancesWithCinderVolumes-1834154807 None] attachment_update completed successfully. Jul 09 14:22:15 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2a703522-9507-4f35-a058-f82d010180ce 1073741824 Jul 09 14:22:15 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:16 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2a703522-9507-4f35-a058-f82d010180ce 1073741824" returned: 0 in 0.997s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2a703522-9507-4f35-a058-f82d010180ce {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:16 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2a703522-9507-4f35-a058-f82d010180ce Jul 09 14:22:16 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:17 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2a703522-9507-4f35-a058-f82d010180ce" returned: 0 in 0.888s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:22:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77b3976-70bc-46f9-b990-2b9b9ea3d12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a703522-9507-4f35-a058-f82d010180ce', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05cafea4-0119-4b50-a092-ddf7eb5b45b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:17 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Volume volume-2a703522-9507-4f35-a058-f82d010180ce (2a703522-9507-4f35-a058-f82d010180ce): created successfully Jul 09 14:22:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05cafea4-0119-4b50-a092-ddf7eb5b45b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Flow 'volume_create_manager' (fc2a861a-c708-4168-9f23-5c0663b76535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:22:17 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-dc0faea6-52ae-4f67-9835-8fdae6eb2668 tempest-ProjectReaderTests-210099421 None] Created volume successfully. Jul 09 14:22:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] Acquiring lock "cinder-2a703522-9507-4f35-a058-f82d010180ce-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:22:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] Lock "cinder-2a703522-9507-4f35-a058-f82d010180ce-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:22:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] Acquiring lock "cinder-quobyte-2a703522-9507-4f35-a058-f82d010180ce" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:22:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] Lock "cinder-quobyte-2a703522-9507-4f35-a058-f82d010180ce" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:22:19 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[38878f41-3361-407d-b589-3941b30b1d83]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:22:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2a703522-9507-4f35-a058-f82d010180ce {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:19 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2a703522-9507-4f35-a058-f82d010180ce Jul 09 14:22:19 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:20 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2a703522-9507-4f35-a058-f82d010180ce" returned: 0 in 1.375s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2a703522-9507-4f35-a058-f82d010180ce {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:20 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2a703522-9507-4f35-a058-f82d010180ce Jul 09 14:22:20 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:21 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2a703522-9507-4f35-a058-f82d010180ce" returned: 0 in 0.771s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] Lock "cinder-quobyte-2a703522-9507-4f35-a058-f82d010180ce" released by "delete_volume" :: held 2.199s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:22:21 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] Created reservations ['93a7e679-b3fd-4801-92a5-3753df69dca9', 'b1a43095-f495-469f-99b8-ad6e95d92e6f', '3ceb7fd1-7492-4ed4-8eaf-613b23c8aaee', '420c7719-1015-4875-8ff4-c131b5a5881d'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:22:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:22:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:22:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:21 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:22:21 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:22 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.130s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:22 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:22:22 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] Deleted volume successfully. Jul 09 14:22:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-40d11d1e-232d-4c15-834d-5a8fdb087ef7 tempest-ProjectReaderTests-210099421 None] Lock "cinder-2a703522-9507-4f35-a058-f82d010180ce-delete_volume" released by "delete_volume" :: held 3.600s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Flow 'volume_create_manager' (0d023f49-4ff9-489b-b078-cac0d442e29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (746694f9-4ae3-4bed-ab89-611ff9543ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (746694f9-4ae3-4bed-ab89-611ff9543ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1152072378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ce56d7-4bf5-4682-a534-f704acd61daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830656ddff2f42aca9a1cd6d512473d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:22:23Z,use_quota=True,user_id='a35f24f4772a4b80817097dc53eb7f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e464088c-2d00-41ca-ac45-78a5e6ce0c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e464088c-2d00-41ca-ac45-78a5e6ce0c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab758b93-c5eb-4d4a-8c77-ad1779318db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab758b93-c5eb-4d4a-8c77-ad1779318db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00ce56d7-4bf5-4682-a534-f704acd61daf', 'volume_name': 'volume-00ce56d7-4bf5-4682-a534-f704acd61daf', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c467cbb-0840-4073-83f7-8790cbb05e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c467cbb-0840-4073-83f7-8790cbb05e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c857391-1cb4-4775-9daf-0fdd1042ea73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:23 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Volume 00ce56d7-4bf5-4682-a534-f704acd61daf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00ce56d7-4bf5-4682-a534-f704acd61daf', 'volume_size': 1} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1152072378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ce56d7-4bf5-4682-a534-f704acd61daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='830656ddff2f42aca9a1cd6d512473d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:22:23Z,use_quota=True,user_id='a35f24f4772a4b80817097dc53eb7f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Creating volume 00ce56d7-4bf5-4682-a534-f704acd61daf {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:22:23 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:22:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00ce56d7-4bf5-4682-a534-f704acd61daf 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:23 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00ce56d7-4bf5-4682-a534-f704acd61daf 1073741824 Jul 09 14:22:23 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:25 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00ce56d7-4bf5-4682-a534-f704acd61daf 1073741824" returned: 0 in 1.614s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00ce56d7-4bf5-4682-a534-f704acd61daf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:25 devstack sudo[101288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00ce56d7-4bf5-4682-a534-f704acd61daf Jul 09 14:22:25 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:26 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00ce56d7-4bf5-4682-a534-f704acd61daf" returned: 0 in 1.216s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] <== create_volume: return (2920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:22:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.923s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c857391-1cb4-4775-9daf-0fdd1042ea73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00ce56d7-4bf5-4682-a534-f704acd61daf', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d97f56-6980-4bfb-884b-955d95431a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:26 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Volume volume-00ce56d7-4bf5-4682-a534-f704acd61daf (00ce56d7-4bf5-4682-a534-f704acd61daf): created successfully Jul 09 14:22:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d97f56-6980-4bfb-884b-955d95431a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Flow 'volume_create_manager' (0d023f49-4ff9-489b-b078-cac0d442e29e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:22:26 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-90cc2d97-9553-4d05-b227-b008ec7737a1 tempest-ProjectReaderTests-210099421 None] Created volume successfully. Jul 09 14:22:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] Acquiring lock "cinder-1c32deef-3770-45ce-9629-2822c2f99556-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:22:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] Lock "cinder-1c32deef-3770-45ce-9629-2822c2f99556-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:22:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] Acquiring lock "cinder-quobyte-1c32deef-3770-45ce-9629-2822c2f99556" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:22:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] Lock "cinder-quobyte-1c32deef-3770-45ce-9629-2822c2f99556" acquired by "delete_volume" :: waited 0.026s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:22:26 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cf7c8e-2bc7-4440-b71e-c954f3f8d784]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:22:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1c32deef-3770-45ce-9629-2822c2f99556 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:27 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1c32deef-3770-45ce-9629-2822c2f99556 Jul 09 14:22:27 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] Acquiring lock "cinder-00ce56d7-4bf5-4682-a534-f704acd61daf-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:22:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] Lock "cinder-00ce56d7-4bf5-4682-a534-f704acd61daf-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:22:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] Acquiring lock "cinder-quobyte-00ce56d7-4bf5-4682-a534-f704acd61daf" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:22:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] Lock "cinder-quobyte-00ce56d7-4bf5-4682-a534-f704acd61daf" acquired by "delete_volume" :: waited 0.041s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:22:28 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[2247a93c-91cd-486e-b5e7-497f79116b87]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:22:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00ce56d7-4bf5-4682-a534-f704acd61daf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:28 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00ce56d7-4bf5-4682-a534-f704acd61daf Jul 09 14:22:28 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:28 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1c32deef-3770-45ce-9629-2822c2f99556" returned: 0 in 1.514s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1c32deef-3770-45ce-9629-2822c2f99556 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:28 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1c32deef-3770-45ce-9629-2822c2f99556 Jul 09 14:22:28 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:29 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00ce56d7-4bf5-4682-a534-f704acd61daf" returned: 0 in 1.289s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00ce56d7-4bf5-4682-a534-f704acd61daf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:29 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00ce56d7-4bf5-4682-a534-f704acd61daf Jul 09 14:22:29 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:29 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1c32deef-3770-45ce-9629-2822c2f99556" returned: 0 in 1.112s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] Lock "cinder-quobyte-1c32deef-3770-45ce-9629-2822c2f99556" released by "delete_volume" :: held 2.704s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:22:29 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] Created reservations ['15ee3521-b322-4972-a478-45981a1e7ef9', 'de35509f-2d81-4b4c-8e7c-09551c818b74', 'fffc17dc-abeb-483b-a2bb-c2fe393da18f', '557984de-81e6-4bc5-b936-1d81752e4594'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:22:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:22:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:22:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:29 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:22:29 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:30 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-00ce56d7-4bf5-4682-a534-f704acd61daf" returned: 0 in 1.088s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] Lock "cinder-quobyte-00ce56d7-4bf5-4682-a534-f704acd61daf" released by "delete_volume" :: held 2.470s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:22:30 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] Created reservations ['1bfdf17d-4d63-4d5b-9191-fe1c6d8bdd15', '86885924-a527-4203-9064-d9db41df1707', '9da885e3-39d2-453f-b5ca-3fd18fee42ea', '5c0d7b37-1b1a-48ce-a92c-4bf91d366cb1'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:22:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:30 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:22:30 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:22:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:30 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:22:30 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:31 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.787s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:31 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:22:31 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] Deleted volume successfully. Jul 09 14:22:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fa0a744e-eee0-4192-9333-f9332cbf16d8 tempest-VolumesNegativeTest-1360221970 None] Lock "cinder-1c32deef-3770-45ce-9629-2822c2f99556-delete_volume" released by "delete_volume" :: held 4.904s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:22:31 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.876s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:31 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:22:31 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] Deleted volume successfully. Jul 09 14:22:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-453c87b9-fc6e-4e81-ace2-cf4487b898d9 tempest-ProjectReaderTests-210099421 None] Lock "cinder-00ce56d7-4bf5-4682-a534-f704acd61daf-delete_volume" released by "delete_volume" :: held 3.914s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:22:35 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=84,cinder:INSERT=29,cinder:UPDATE=118,cinder:DELETE=9 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:22:35 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=104,cinder:SELECT=86,cinder:INSERT=33,cinder:DELETE=9 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:22:35 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:22:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Flow 'volume_create_manager' (3815a36b-cdae-415a-b23f-4757644b020a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:22:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f2b308-2ae8-464c-949d-b9aebfce069f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f2b308-2ae8-464c-949d-b9aebfce069f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b13896f511744dbbed90d963865ac2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:22:36Z,use_quota=True,user_id='ac09b2e293594418ae045dddb33fcca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c49431e-7693-4b43-b21a-4ae6a61fdaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c49431e-7693-4b43-b21a-4ae6a61fdaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e66d822-399c-4573-99de-b9642ae71bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:35 devstack cinder-volume[87011]: DEBUG cinder.image.glance [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Creating Keystone auth plugin from conf {{(pid=87011) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 14:22:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e66d822-399c-4573-99de-b9642ae71bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2', 'volume_name': 'volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2', 'volume_size': 1, 'image_id': 'cb7da270-7794-4740-8a4c-00793f1bf019', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb7da270-7794-4740-8a4c-00793f1bf019', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5c124223145bb5fc953567ae5a9b87e3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2b13896f511744dbbed90d963865ac2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6498caaa4b6cb255e078f055af5598b841f313ddaff406dc2bf53e30d4f4397f68a6e7db5375fbbbd9970b27a3a6a1b52b97b870ff2427c8a331fb6085ad260b', 'id': 'cb7da270-7794-4740-8a4c-00793f1bf019', 'created_at': datetime.datetime(2026, 7, 9, 12, 22, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 22, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb7da270-7794-4740-8a4c-00793f1bf019/file', 'properties': {}}, 'image_service': }' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a173ad-2634-48d0-bdc9-380886a6bdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a173ad-2634-48d0-bdc9-380886a6bdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74b90a5-e949-4eb0-b77f-acb2eccba6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:36 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Volume cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2', 'volume_size': 1, 'image_id': 'cb7da270-7794-4740-8a4c-00793f1bf019', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb7da270-7794-4740-8a4c-00793f1bf019', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5c124223145bb5fc953567ae5a9b87e3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2b13896f511744dbbed90d963865ac2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6498caaa4b6cb255e078f055af5598b841f313ddaff406dc2bf53e30d4f4397f68a6e7db5375fbbbd9970b27a3a6a1b52b97b870ff2427c8a331fb6085ad260b', 'id': 'cb7da270-7794-4740-8a4c-00793f1bf019', 'created_at': datetime.datetime(2026, 7, 9, 12, 22, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 22, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb7da270-7794-4740-8a4c-00793f1bf019/file', 'properties': {}}, 'image_service': } Jul 09 14:22:36 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Trying to clone cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 from image cb7da270-7794-4740-8a4c-00793f1bf019 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb7da270-7794-4740-8a4c-00793f1bf019', 'metadata': {}}]). {{(pid=87011) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 14:22:36 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 14:22:36 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Image download 0.00 MB at 0.00 MB/s Jul 09 14:22:36 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7daddd-6cf8-4840-ae7c-ce3fb6808c85]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:22:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:36 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD Jul 09 14:22:36 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:37 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD" returned: 0 in 0.987s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:37 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD Jul 09 14:22:37 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:38 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD" returned: 1 in 0.826s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:22:38 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Temporary image cb7da270-7794-4740-8a4c-00793f1bf019 is fetched for user ac09b2e293594418ae045dddb33fcca7. {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 14:22:38 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[916850b1-8a65-4f15-8d66-728f41a2a6e1]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:22:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:38 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD Jul 09 14:22:38 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:39 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD" returned: 0 in 0.743s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:39 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD Jul 09 14:22:39 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:40 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD" returned: 1 in 0.827s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:22:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b13896f511744dbbed90d963865ac2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:22:36Z,use_quota=True,user_id='ac09b2e293594418ae045dddb33fcca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:22:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Creating volume cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:22:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:22:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:22:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:22:40 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:22:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:40 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 1073741824 Jul 09 14:22:40 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:40 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 1073741824" returned: 0 in 0.842s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:40 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 Jul 09 14:22:40 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:41 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2" returned: 0 in 0.794s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:22:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:41 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Attempting download of cb7da270-7794-4740-8a4c-00793f1bf019 ((None, [{'url': 'file:///opt/stack/data/glance/images/cb7da270-7794-4740-8a4c-00793f1bf019', 'metadata': {}}])) to volume cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2. {{(pid=87011) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 14:22:41 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83533c1-488c-415d-bf03-791712dc6322]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:22:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb7da270-7794-4740-8a4c-00793f1bf019_7tsfem8t {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:41 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb7da270-7794-4740-8a4c-00793f1bf019_7tsfem8t Jul 09 14:22:41 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:42 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb7da270-7794-4740-8a4c-00793f1bf019_7tsfem8t" returned: 0 in 0.737s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb7da270-7794-4740-8a4c-00793f1bf019_7tsfem8t {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:42 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb7da270-7794-4740-8a4c-00793f1bf019_7tsfem8t Jul 09 14:22:42 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:43 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb7da270-7794-4740-8a4c-00793f1bf019_7tsfem8t" returned: 1 in 0.746s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb7da270-7794-4740-8a4c-00793f1bf019_7tsfem8t' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:22:43 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0de03c-eec3-49be-abdc-3aace1eecf2a]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:22:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:43 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD Jul 09 14:22:43 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:44 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD" returned: 0 in 0.802s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:44 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD Jul 09 14:22:44 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:44 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD" returned: 1 in 0.718s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:22:44 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] cb7da270-7794-4740-8a4c-00793f1bf019 was raw, converting to raw {{(pid=87011) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 14:22:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:44 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 Jul 09 14:22:44 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:45 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2" returned: 0 in 0.818s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:45 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb7da270-7794-4740-8a4c-00793f1bf019_gu9qo9ojdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:22:45 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 14:22:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:45 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 1G Jul 09 14:22:45 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:46 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 1G" returned: 0 in 0.998s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:46 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9ede83-c199-4f5e-be46-ab0bb4983e59]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:22:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:46 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 Jul 09 14:22:46 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:47 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2" returned: 0 in 0.862s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:47 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 Jul 09 14:22:47 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:48 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2" returned: 1 in 0.871s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:22:48 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Downloaded image cb7da270-7794-4740-8a4c-00793f1bf019 ((None, [{'url': 'file:///opt/stack/data/glance/images/cb7da270-7794-4740-8a4c-00793f1bf019', 'metadata': {}}])) to volume cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 successfully. {{(pid=87011) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 14:22:48 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Temporary image cb7da270-7794-4740-8a4c-00793f1bf019 for user ac09b2e293594418ae045dddb33fcca7 is deleted. {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 14:22:48 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Marking volume cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 as bootable. {{(pid=87011) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 14:22:48 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Copying metadata from image cb7da270-7794-4740-8a4c-00793f1bf019 to cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2. {{(pid=87011) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 14:22:48 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Creating volume glance metadata for volume cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 backed by image cb7da270-7794-4740-8a4c-00793f1bf019 with: {'image_id': 'cb7da270-7794-4740-8a4c-00793f1bf019', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5c124223145bb5fc953567ae5a9b87e3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87011) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 14:22:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74b90a5-e949-4eb0-b77f-acb2eccba6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2', 'volume_size': 1, 'image_id': 'cb7da270-7794-4740-8a4c-00793f1bf019', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb7da270-7794-4740-8a4c-00793f1bf019', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5c124223145bb5fc953567ae5a9b87e3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2b13896f511744dbbed90d963865ac2c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6498caaa4b6cb255e078f055af5598b841f313ddaff406dc2bf53e30d4f4397f68a6e7db5375fbbbd9970b27a3a6a1b52b97b870ff2427c8a331fb6085ad260b', 'id': 'cb7da270-7794-4740-8a4c-00793f1bf019', 'created_at': datetime.datetime(2026, 7, 9, 12, 22, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 22, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb7da270-7794-4740-8a4c-00793f1bf019/file', 'properties': {}}, 'image_service': }' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ca0ba1-7f74-47f1-a969-34cbaead93d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:48 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Volume volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 (cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2): created successfully Jul 09 14:22:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ca0ba1-7f74-47f1-a969-34cbaead93d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Flow 'volume_create_manager' (3815a36b-cdae-415a-b23f-4757644b020a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:22:48 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-64419261-216e-4318-b84d-f9c31622734e tempest-VolumeImageDependencyTests-308884137 None] Created volume successfully. Jul 09 14:22:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] Acquiring lock "cinder-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:22:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] Lock "cinder-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:22:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] Acquiring lock "cinder-quobyte-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:22:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] Lock "cinder-quobyte-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2" acquired by "delete_volume" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:22:48 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[7856a510-880a-4288-a1d7-25ee0305534c]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:22:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:49 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 Jul 09 14:22:49 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:49 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2" returned: 0 in 0.851s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:49 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 Jul 09 14:22:49 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:50 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2" returned: 1 in 0.868s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:22:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:50 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2 Jul 09 14:22:50 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:51 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2" returned: 0 in 0.689s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] Lock "cinder-quobyte-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2" released by "delete_volume" :: held 2.494s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:22:51 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] Created reservations ['c9048a81-a148-46df-bd62-d93476bf7ddd', '9747d48f-65c6-4829-a215-a301013f4ea2', '4e3c2f03-6286-4852-b34f-4a966f8eb2bd', 'f9d1700b-3569-47c7-8dfd-d80c518e334f'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:22:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:22:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:22:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:51 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:22:51 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:52 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.814s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:52 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:22:52 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] Deleted volume successfully. Jul 09 14:22:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-620f7d27-6fc5-4be3-871d-37d5fb0ff0cf tempest-VolumeImageDependencyTests-308884137 None] Lock "cinder-cf4c1653-686b-4ed2-9ea1-c0badb2cc1c2-delete_volume" released by "delete_volume" :: held 3.566s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:22:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-44baa3eb-9172-414e-a2d9-25fe0d2b63ad req-dcb91a18-69d7-4053-9e3b-0638b541f762 tempest-TestInstancesWithCinderVolumes-1834154807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-44baa3eb-9172-414e-a2d9-25fe0d2b63ad req-dcb91a18-69d7-4053-9e3b-0638b541f762 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:52 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5022297d-afe1-476b-a990-2cbbfd988f92]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:22:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-44baa3eb-9172-414e-a2d9-25fe0d2b63ad req-dcb91a18-69d7-4053-9e3b-0638b541f762 tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7930e22d-d441-43d2-b6f8-66e2d64b282e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:52 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7930e22d-d441-43d2-b6f8-66e2d64b282e Jul 09 14:22:52 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:53 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-44baa3eb-9172-414e-a2d9-25fe0d2b63ad req-dcb91a18-69d7-4053-9e3b-0638b541f762 tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7930e22d-d441-43d2-b6f8-66e2d64b282e" returned: 0 in 0.862s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-44baa3eb-9172-414e-a2d9-25fe0d2b63ad req-dcb91a18-69d7-4053-9e3b-0638b541f762 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.896s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-44baa3eb-9172-414e-a2d9-25fe0d2b63ad req-dcb91a18-69d7-4053-9e3b-0638b541f762 tempest-TestInstancesWithCinderVolumes-1834154807 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-7930e22d-d441-43d2-b6f8-66e2d64b282e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9586a187-f21b-4da8-8de6-6d91a57800af', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:22:53 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-44baa3eb-9172-414e-a2d9-25fe0d2b63ad req-dcb91a18-69d7-4053-9e3b-0638b541f762 tempest-TestInstancesWithCinderVolumes-1834154807 None] attachment_update completed successfully. Jul 09 14:22:56 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:22:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Flow 'volume_create_manager' (18fa4159-5bc7-474a-8119-d951a1f911e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:22:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6d37a1-457e-434f-ba40-73b843cc0cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6d37a1-457e-434f-ba40-73b843cc0cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd19029-c0bc-4012-bc66-e07d7829bc44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23b18a8ddad4e74af3a29fa89475e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:22:57Z,use_quota=True,user_id='441beeb4ed4e4030b762e6f5fb98212d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6016fb12-e304-490f-a2ca-c80aa981487a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6016fb12-e304-490f-a2ca-c80aa981487a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6679d59-4aec-4262-9d8c-c3547a751584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6679d59-4aec-4262-9d8c-c3547a751584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cd19029-c0bc-4012-bc66-e07d7829bc44', 'volume_name': 'volume-5cd19029-c0bc-4012-bc66-e07d7829bc44', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (996f820b-fa1d-4f5d-ba67-02933a8c4256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (996f820b-fa1d-4f5d-ba67-02933a8c4256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e3b52b-f6d2-4859-ad11-67bb26f0efe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:57 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Volume 5cd19029-c0bc-4012-bc66-e07d7829bc44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cd19029-c0bc-4012-bc66-e07d7829bc44', 'volume_size': 1} Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd19029-c0bc-4012-bc66-e07d7829bc44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23b18a8ddad4e74af3a29fa89475e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:22:57Z,use_quota=True,user_id='441beeb4ed4e4030b762e6f5fb98212d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Creating volume 5cd19029-c0bc-4012-bc66-e07d7829bc44 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:22:57 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5cd19029-c0bc-4012-bc66-e07d7829bc44 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:57 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5cd19029-c0bc-4012-bc66-e07d7829bc44 1073741824 Jul 09 14:22:57 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:57 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5cd19029-c0bc-4012-bc66-e07d7829bc44 1073741824" returned: 0 in 0.923s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5cd19029-c0bc-4012-bc66-e07d7829bc44 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:58 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5cd19029-c0bc-4012-bc66-e07d7829bc44 Jul 09 14:22:58 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:22:58 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Jul 09 14:22:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5cd19029-c0bc-4012-bc66-e07d7829bc44" returned: 0 in 0.733s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:22:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:22:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e3b52b-f6d2-4859-ad11-67bb26f0efe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cd19029-c0bc-4012-bc66-e07d7829bc44', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e7b43a-47c2-48d7-b9e8-a4e5e6f827ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:58 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Volume volume-5cd19029-c0bc-4012-bc66-e07d7829bc44 (5cd19029-c0bc-4012-bc66-e07d7829bc44): created successfully Jul 09 14:22:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e7b43a-47c2-48d7-b9e8-a4e5e6f827ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Flow 'volume_create_manager' (18fa4159-5bc7-474a-8119-d951a1f911e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:22:58 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b1875c53-0eb9-4c76-8df8-638f0bd91864 tempest-CinderUnicodeTest-1814489214 None] Created volume successfully. Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Flow 'volume_create_manager' (44ab065f-058c-45d4-ad9f-ad79fd4190f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea330432-7254-4047-a360-20fcc7a81e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea330432-7254-4047-a360-20fcc7a81e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:22:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1198427163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38ee424-f5b1-4be1-b5a6-50fd018c7744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23b18a8ddad4e74af3a29fa89475e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:23:00Z,use_quota=True,user_id='441beeb4ed4e4030b762e6f5fb98212d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b75f4484-c287-4c99-a762-621f44ab9faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b75f4484-c287-4c99-a762-621f44ab9faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d28580-7256-4afb-bc55-b3c21ace80b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d28580-7256-4afb-bc55-b3c21ace80b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f38ee424-f5b1-4be1-b5a6-50fd018c7744', 'volume_name': 'volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d05568f-5b72-4af2-8856-0fcaff4b939b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d05568f-5b72-4af2-8856-0fcaff4b939b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dbba0a-744a-4830-9b4f-b020df4b5400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:22:59 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Volume f38ee424-f5b1-4be1-b5a6-50fd018c7744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744', 'volume_size': 1} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:22:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1198427163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38ee424-f5b1-4be1-b5a6-50fd018c7744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23b18a8ddad4e74af3a29fa89475e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:23:00Z,use_quota=True,user_id='441beeb4ed4e4030b762e6f5fb98212d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Creating volume f38ee424-f5b1-4be1-b5a6-50fd018c7744 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:22:59 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:22:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:22:59 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744 1073741824 Jul 09 14:22:59 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:00 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744 1073741824" returned: 0 in 0.957s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:00 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744 Jul 09 14:23:00 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:01 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744" returned: 0 in 0.641s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:01 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:23:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:23:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dbba0a-744a-4830-9b4f-b020df4b5400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:23:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50bda11f-f775-4551-8f9b-9c4bce67d812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:23:01 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Volume volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744 (f38ee424-f5b1-4be1-b5a6-50fd018c7744): created successfully Jul 09 14:23:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50bda11f-f775-4551-8f9b-9c4bce67d812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:23:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Flow 'volume_create_manager' (44ab065f-058c-45d4-ad9f-ad79fd4190f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:23:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-1bf4138d-5172-4c39-96b3-0eeea76c26d9 req-cc2079a9-8c70-4e5a-a017-cee5da87533a tempest-TestInstancesWithCinderVolumes-1834154807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:23:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-1bf4138d-5172-4c39-96b3-0eeea76c26d9 req-cc2079a9-8c70-4e5a-a017-cee5da87533a tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:23:01 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-8da17b1e-269b-451c-9ce8-04f6c7516a66 tempest-CinderUnicodeTest-1814489214 None] Created volume successfully. Jul 09 14:23:01 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e81f801-7248-4689-be4d-8141f7cb147a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:23:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-1bf4138d-5172-4c39-96b3-0eeea76c26d9 req-cc2079a9-8c70-4e5a-a017-cee5da87533a tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3e114037-7ee2-4d70-a71f-59553ad75a3e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:01 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3e114037-7ee2-4d70-a71f-59553ad75a3e Jul 09 14:23:01 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:23:02 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-1bf4138d-5172-4c39-96b3-0eeea76c26d9 req-cc2079a9-8c70-4e5a-a017-cee5da87533a tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3e114037-7ee2-4d70-a71f-59553ad75a3e" returned: 0 in 0.772s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-1bf4138d-5172-4c39-96b3-0eeea76c26d9 req-cc2079a9-8c70-4e5a-a017-cee5da87533a tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.796s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:23:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.249s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:23:02 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] Creating offline snapshot 23e3c327-e025-4269-af9c-9099a862ea5a of volume f38ee424-f5b1-4be1-b5a6-50fd018c7744 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:23:02 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ccf31b-ed96-4752-8b68-6d8b180a103f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:23:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-1bf4138d-5172-4c39-96b3-0eeea76c26d9 req-cc2079a9-8c70-4e5a-a017-cee5da87533a tempest-TestInstancesWithCinderVolumes-1834154807 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-3e114037-7ee2-4d70-a71f-59553ad75a3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1395085-6fd5-40e4-879b-a291e56aea7c', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:23:02 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-1bf4138d-5172-4c39-96b3-0eeea76c26d9 req-cc2079a9-8c70-4e5a-a017-cee5da87533a tempest-TestInstancesWithCinderVolumes-1834154807 None] attachment_update completed successfully. Jul 09 14:23:02 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744 Jul 09 14:23:02 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:03 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744" returned: 0 in 0.820s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:03 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a 1G Jul 09 14:23:03 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:03 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a 1G" returned: 0 in 0.795s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:03 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a Jul 09 14:23:03 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:04 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a" returned: 0 in 0.664s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:04 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a is being set with open permissions: ugo+rw Jul 09 14:23:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:04 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a Jul 09 14:23:04 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:05 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a" returned: 0 in 0.731s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:05 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.info Jul 09 14:23:05 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:06 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.info" returned: 0 in 0.837s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:06 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.info is being set with open permissions: ugo+rw Jul 09 14:23:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:06 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.info Jul 09 14:23:06 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:06 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.info" returned: 0 in 0.741s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.713s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:23:06 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-fc19b367-f427-44c3-a239-4f008d6ca033 tempest-CinderUnicodeTest-1814489214 None] Create snapshot completed successfully Jul 09 14:23:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] Acquiring lock "cinder-23e3c327-e025-4269-af9c-9099a862ea5a-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:23:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] Lock "cinder-23e3c327-e025-4269-af9c-9099a862ea5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:23:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] Acquiring lock "cinder-quobyte-f38ee424-f5b1-4be1-b5a6-50fd018c7744" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:23:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] Lock "cinder-quobyte-f38ee424-f5b1-4be1-b5a6-50fd018c7744" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:23:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] Acquiring lock "cinder-quobyte-23e3c327-e025-4269-af9c-9099a862ea5a" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:23:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] Lock "cinder-quobyte-23e3c327-e025-4269-af9c-9099a862ea5a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:23:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] Deleting offline snapshot 23e3c327-e025-4269-af9c-9099a862ea5a of volume f38ee424-f5b1-4be1-b5a6-50fd018c7744 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:23:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] snapshot_file for this snap is: volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:23:07 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[e817c717-7be7-4ac9-8d8e-d174822ddd56]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:23:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:07 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a Jul 09 14:23:07 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:08 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a" returned: 0 in 0.912s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:23:08 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[4278c1a6-e003-47ae-9c0d-7e12d7a0f78c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:23:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:08 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744 Jul 09 14:23:08 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:09 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744" returned: 0 in 0.795s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:09 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a Jul 09 14:23:09 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:09 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a" returned: 0 in 0.752s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:09 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a Jul 09 14:23:09 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:10 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744.23e3c327-e025-4269-af9c-9099a862ea5a" returned: 0 in 0.810s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] Lock "cinder-quobyte-23e3c327-e025-4269-af9c-9099a862ea5a" released by "_delete_snapshot" :: held 3.415s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:23:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] Lock "cinder-quobyte-f38ee424-f5b1-4be1-b5a6-50fd018c7744" released by "delete_snapshot" :: held 3.442s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:23:10 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] Created reservations ['a933abcb-baa7-4473-98cd-9d820d3e76f3', 'f3fb0678-b083-452d-8867-cc18558f0eef', '1f7df4e8-b68f-41f3-98b2-1446ce909cc6', '04befb7d-c5bc-40ff-9bd6-06226bb7395b'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:23:10 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] Delete snapshot completed successfully. Jul 09 14:23:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3b7fa1bf-8e78-49a8-805d-7a2a06f3a757 tempest-CinderUnicodeTest-1814489214 None] Lock "cinder-23e3c327-e025-4269-af9c-9099a862ea5a-delete_snapshot" released by "delete_snapshot" :: held 3.632s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:23:11 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] Acquiring lock "cinder-f38ee424-f5b1-4be1-b5a6-50fd018c7744-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:23:11 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] Lock "cinder-f38ee424-f5b1-4be1-b5a6-50fd018c7744-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:23:11 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] Acquiring lock "cinder-quobyte-f38ee424-f5b1-4be1-b5a6-50fd018c7744" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:23:11 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] Lock "cinder-quobyte-f38ee424-f5b1-4be1-b5a6-50fd018c7744" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:23:11 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[e022cf38-e7bb-4b2e-a438-c349db040d3c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:23:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:11 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-3c92f8aa-fecf-47ff-974c-8915ba356c7e req-69171e99-4f1b-4a1c-afd0-6dca3bd6dac8 tempest-TestInstancesWithCinderVolumes-1834154807 None] Terminate volume connection completed successfully. Jul 09 14:23:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-3c92f8aa-fecf-47ff-974c-8915ba356c7e req-69171e99-4f1b-4a1c-afd0-6dca3bd6dac8 tempest-TestInstancesWithCinderVolumes-1834154807 None] Deleting attachment 9586a187-f21b-4da8-8de6-6d91a57800af. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:23:11 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744 Jul 09 14:23:11 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:12 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744" returned: 0 in 0.741s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:12 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744 Jul 09 14:23:12 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:23:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:23:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:23:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:23:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:23:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:23:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:12 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:23:12 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:13 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f38ee424-f5b1-4be1-b5a6-50fd018c7744" returned: 0 in 0.776s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] Lock "cinder-quobyte-f38ee424-f5b1-4be1-b5a6-50fd018c7744" released by "delete_volume" :: held 1.593s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:23:13 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.736s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] Created reservations ['f043c77e-dd47-4f00-8d15-421d9ead513a', '87a77d2a-c66f-4943-bc89-d6c002f49249', '8e0b3bfd-ac66-4f71-bc7f-5802346fc7a8', 'feb5c2af-bf8d-466a-ae04-b1ab745b7f49'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:13 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:23:13 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Acquiring lock "cinder-7930e22d-d441-43d2-b6f8-66e2d64b282e-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "cinder-7930e22d-d441-43d2-b6f8-66e2d64b282e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Acquiring lock "cinder-quobyte-7930e22d-d441-43d2-b6f8-66e2d64b282e" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "cinder-quobyte-7930e22d-d441-43d2-b6f8-66e2d64b282e" acquired by "delete_volume" :: waited 0.042s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] Acquiring lock "cinder-5cd19029-c0bc-4012-bc66-e07d7829bc44-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c928224-7006-4b3f-9c86-fa7047edc61b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:23:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7930e22d-d441-43d2-b6f8-66e2d64b282e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] Lock "cinder-5cd19029-c0bc-4012-bc66-e07d7829bc44-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:23:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] Acquiring lock "cinder-quobyte-5cd19029-c0bc-4012-bc66-e07d7829bc44" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:23:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] Lock "cinder-quobyte-5cd19029-c0bc-4012-bc66-e07d7829bc44" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:23:14 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7930e22d-d441-43d2-b6f8-66e2d64b282e Jul 09 14:23:14 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:14 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba799193-cba8-409c-951d-8ded408cb578]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:23:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5cd19029-c0bc-4012-bc66-e07d7829bc44 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:14 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5cd19029-c0bc-4012-bc66-e07d7829bc44 Jul 09 14:23:14 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:14 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.110s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:14 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:23:14 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] Deleted volume successfully. Jul 09 14:23:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3aca8e3d-66f3-4b9c-8261-07170b9508b4 tempest-CinderUnicodeTest-1814489214 None] Lock "cinder-f38ee424-f5b1-4be1-b5a6-50fd018c7744-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:23:15 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7930e22d-d441-43d2-b6f8-66e2d64b282e" returned: 0 in 1.045s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7930e22d-d441-43d2-b6f8-66e2d64b282e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:15 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7930e22d-d441-43d2-b6f8-66e2d64b282e Jul 09 14:23:15 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:15 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5cd19029-c0bc-4012-bc66-e07d7829bc44" returned: 0 in 1.169s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5cd19029-c0bc-4012-bc66-e07d7829bc44 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:15 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5cd19029-c0bc-4012-bc66-e07d7829bc44 Jul 09 14:23:15 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:15 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7930e22d-d441-43d2-b6f8-66e2d64b282e" returned: 0 in 0.969s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "cinder-quobyte-7930e22d-d441-43d2-b6f8-66e2d64b282e" released by "delete_volume" :: held 2.132s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:23:16 devstack cinder-volume[87011]: WARNING cinder.quota [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1353672102-1813207569 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1353672102-1813207569, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:23:16 devstack cinder-volume[87011]: WARNING cinder.quota [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1353672102-1813207569 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1353672102-1813207569, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:23:16 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Created reservations ['78a5210e-6427-4514-adc7-bf90d868d4ac', '57c5085d-be7a-41e0-b886-773c2d9a2859', '769a01fd-2be7-4932-a63b-d5a481da33ef', 'b82af3f5-81b2-4058-b8e3-8f13b7ff9195'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:23:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:23:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:23:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:23:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:23:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:23:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:16 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5cd19029-c0bc-4012-bc66-e07d7829bc44" returned: 0 in 0.993s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:16 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:23:16 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] Lock "cinder-quobyte-5cd19029-c0bc-4012-bc66-e07d7829bc44" released by "delete_volume" :: held 2.247s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:23:16 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] Created reservations ['1616520e-890a-4157-b90c-bbf25aaabf8f', '7607d480-5ed4-4a11-b32c-875681e88933', '178a6729-55a3-473e-82db-971a72c9b809', 'e898bc70-081e-4c5a-92dd-1073e1771500'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:23:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:23:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:23:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:23:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:23:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:23:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:16 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:23:16 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:17 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.900s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:23:17 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] Deleted volume successfully. Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8bd3a0ac-c468-4105-aeb8-3d89ee38182c tempest-CinderUnicodeTest-1814489214 None] Lock "cinder-5cd19029-c0bc-4012-bc66-e07d7829bc44-delete_volume" released by "delete_volume" :: held 3.457s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Flow 'volume_create_manager' (417da907-5dd8-49f9-a21a-bf6dd99480ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2325d7ae-19aa-487d-b786-a8b7d9fbf13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2325d7ae-19aa-487d-b786-a8b7d9fbf13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1392532317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49ef4b5e-4839-490d-ae97-837b64d90eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e9ce5c3c41c4fc3b946b5cbcb46a913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:23:17Z,use_quota=True,user_id='f95f4dfcc02c44aeab4af331adcb60cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:23:17 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876fa435-c487-4744-8895-58cbc0cc0b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876fa435-c487-4744-8895-58cbc0cc0b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d31a93-ddbe-44d8-88ab-18aa81682eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d31a93-ddbe-44d8-88ab-18aa81682eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49ef4b5e-4839-490d-ae97-837b64d90eb3', 'volume_name': 'volume-49ef4b5e-4839-490d-ae97-837b64d90eb3', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb05f468-4ab5-48fb-8a28-ab4f93c8984e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb05f468-4ab5-48fb-8a28-ab4f93c8984e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6f8819-3a25-4054-a7db-9449380551cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:23:17 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Volume 49ef4b5e-4839-490d-ae97-837b64d90eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49ef4b5e-4839-490d-ae97-837b64d90eb3', 'volume_size': 1} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1392532317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49ef4b5e-4839-490d-ae97-837b64d90eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e9ce5c3c41c4fc3b946b5cbcb46a913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:23:17Z,use_quota=True,user_id='f95f4dfcc02c44aeab4af331adcb60cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Creating volume 49ef4b5e-4839-490d-ae97-837b64d90eb3 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:23:17 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-49ef4b5e-4839-490d-ae97-837b64d90eb3 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.359s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:23:17 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Deleted volume successfully. Jul 09 14:23:17 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-49ef4b5e-4839-490d-ae97-837b64d90eb3 1073741824 Jul 09 14:23:17 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-65cefcd3-5ac1-4049-878f-282189e5ef48 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "cinder-7930e22d-d441-43d2-b6f8-66e2d64b282e-delete_volume" released by "delete_volume" :: held 3.990s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:23:18 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-49ef4b5e-4839-490d-ae97-837b64d90eb3 1073741824" returned: 0 in 1.120s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-49ef4b5e-4839-490d-ae97-837b64d90eb3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:18 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-49ef4b5e-4839-490d-ae97-837b64d90eb3 Jul 09 14:23:18 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:19 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-49ef4b5e-4839-490d-ae97-837b64d90eb3" returned: 0 in 0.744s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:23:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:23:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6f8819-3a25-4054-a7db-9449380551cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49ef4b5e-4839-490d-ae97-837b64d90eb3', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:23:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fcff238-4c66-4b2c-94c7-84e4086048cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:23:19 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Volume volume-49ef4b5e-4839-490d-ae97-837b64d90eb3 (49ef4b5e-4839-490d-ae97-837b64d90eb3): created successfully Jul 09 14:23:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fcff238-4c66-4b2c-94c7-84e4086048cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:23:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Flow 'volume_create_manager' (417da907-5dd8-49f9-a21a-bf6dd99480ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:23:19 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-5d15dc1b-d4d8-4f58-aa27-af5e1e8170d3 tempest-TestMinimumBasicScenario-119390099 None] Created volume successfully. Jul 09 14:23:20 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-1902ff1b-e431-427e-9878-9e24e2433ee0 req-5b5729c0-beb5-4499-8b4a-bdb16e31aa75 tempest-TestInstancesWithCinderVolumes-1834154807 None] Terminate volume connection completed successfully. Jul 09 14:23:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-1902ff1b-e431-427e-9878-9e24e2433ee0 req-5b5729c0-beb5-4499-8b4a-bdb16e31aa75 tempest-TestInstancesWithCinderVolumes-1834154807 None] Deleting attachment a1395085-6fd5-40e4-879b-a291e56aea7c. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:23:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Acquiring lock "cinder-3e114037-7ee2-4d70-a71f-59553ad75a3e-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:23:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "cinder-3e114037-7ee2-4d70-a71f-59553ad75a3e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:23:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Acquiring lock "cinder-quobyte-3e114037-7ee2-4d70-a71f-59553ad75a3e" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:23:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "cinder-quobyte-3e114037-7ee2-4d70-a71f-59553ad75a3e" acquired by "delete_volume" :: waited 0.034s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:23:22 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[4276576b-1336-492d-9556-133f6b0cdf80]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:23:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3e114037-7ee2-4d70-a71f-59553ad75a3e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:22 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3e114037-7ee2-4d70-a71f-59553ad75a3e Jul 09 14:23:22 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:23 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3e114037-7ee2-4d70-a71f-59553ad75a3e" returned: 0 in 1.164s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3e114037-7ee2-4d70-a71f-59553ad75a3e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:23 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3e114037-7ee2-4d70-a71f-59553ad75a3e Jul 09 14:23:23 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-b1a9476e-9f26-40a4-b9ae-3c21319e97d2 req-60374d97-55b3-46df-ad24-9545542412df tempest-TestMinimumBasicScenario-119390099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:23:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-b1a9476e-9f26-40a4-b9ae-3c21319e97d2 req-60374d97-55b3-46df-ad24-9545542412df tempest-TestMinimumBasicScenario-119390099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:23:24 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ef4fd8-c069-48d0-947c-250895ad80cc]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:23:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-b1a9476e-9f26-40a4-b9ae-3c21319e97d2 req-60374d97-55b3-46df-ad24-9545542412df tempest-TestMinimumBasicScenario-119390099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-49ef4b5e-4839-490d-ae97-837b64d90eb3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:24 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-49ef4b5e-4839-490d-ae97-837b64d90eb3 Jul 09 14:23:24 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:24 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3e114037-7ee2-4d70-a71f-59553ad75a3e" returned: 0 in 1.188s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "cinder-quobyte-3e114037-7ee2-4d70-a71f-59553ad75a3e" released by "delete_volume" :: held 2.413s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:23:24 devstack cinder-volume[87011]: WARNING cinder.quota [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-125943097-2054031497 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-125943097-2054031497, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:23:24 devstack cinder-volume[87011]: WARNING cinder.quota [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-125943097-2054031497 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-125943097-2054031497, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:23:24 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Created reservations ['eb3748be-ea10-4e16-bc7d-e3c1ca9709ef', '68fe88d1-e25e-43c3-b860-b2795faffddf', 'd42387f1-1c28-4fc9-810c-fab16f431290', '01a05aab-402f-420d-9018-28d9c809b2ea'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:23:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:23:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:23:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:23:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:23:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:23:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:25 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:23:25 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:25 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-b1a9476e-9f26-40a4-b9ae-3c21319e97d2 req-60374d97-55b3-46df-ad24-9545542412df tempest-TestMinimumBasicScenario-119390099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-49ef4b5e-4839-490d-ae97-837b64d90eb3" returned: 0 in 1.517s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-b1a9476e-9f26-40a4-b9ae-3c21319e97d2 req-60374d97-55b3-46df-ad24-9545542412df tempest-TestMinimumBasicScenario-119390099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.541s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:23:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-b1a9476e-9f26-40a4-b9ae-3c21319e97d2 req-60374d97-55b3-46df-ad24-9545542412df tempest-TestMinimumBasicScenario-119390099 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-49ef4b5e-4839-490d-ae97-837b64d90eb3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0ef54fb-c118-42a0-b787-31475090e170', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:23:25 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-b1a9476e-9f26-40a4-b9ae-3c21319e97d2 req-60374d97-55b3-46df-ad24-9545542412df tempest-TestMinimumBasicScenario-119390099 None] attachment_update completed successfully. Jul 09 14:23:26 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.387s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:26 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:23:26 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Deleted volume successfully. Jul 09 14:23:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9e9a9589-3192-4928-9480-1e5bdb3daa89 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "cinder-3e114037-7ee2-4d70-a71f-59553ad75a3e-delete_volume" released by "delete_volume" :: held 4.175s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:23:30 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-e25be706-09b5-4eee-99a4-af54c5d7b49c req-0545fabb-0577-4d7d-aa75-b1696cfeb429 tempest-TestInstancesWithCinderVolumes-1834154807 None] Terminate volume connection completed successfully. Jul 09 14:23:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-e25be706-09b5-4eee-99a4-af54c5d7b49c req-0545fabb-0577-4d7d-aa75-b1696cfeb429 tempest-TestInstancesWithCinderVolumes-1834154807 None] Deleting attachment 724d0922-ddc6-46eb-93e4-b4076ab003c4. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:23:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Acquiring lock "cinder-10087aa6-7d34-4da9-b7e8-afd70a21cf06-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:23:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "cinder-10087aa6-7d34-4da9-b7e8-afd70a21cf06-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:23:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Acquiring lock "cinder-quobyte-10087aa6-7d34-4da9-b7e8-afd70a21cf06" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:23:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "cinder-quobyte-10087aa6-7d34-4da9-b7e8-afd70a21cf06" acquired by "delete_volume" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:23:34 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90fd61d-4437-46e8-92d9-b98134157343]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:23:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:34 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 Jul 09 14:23:34 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:34 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06" returned: 0 in 0.795s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:34 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 Jul 09 14:23:34 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:35 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06" returned: 1 in 0.735s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:23:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:35 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06 Jul 09 14:23:35 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:36 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-10087aa6-7d34-4da9-b7e8-afd70a21cf06" returned: 0 in 0.716s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "cinder-quobyte-10087aa6-7d34-4da9-b7e8-afd70a21cf06" released by "delete_volume" :: held 2.322s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:23:36 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:INSERT=23,cinder:UPDATE=51,cinder:SELECT=74,cinder:DELETE=2 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:23:36 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=64,cinder:INSERT=15,cinder:UPDATE=80,cinder:DELETE=8 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:23:36 devstack cinder-volume[87011]: WARNING cinder.quota [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1071044498-1449476486 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1071044498-1449476486, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:23:36 devstack cinder-volume[87011]: WARNING cinder.quota [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1071044498-1449476486 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1071044498-1449476486, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:23:36 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Created reservations ['070c6dba-2ed4-48b1-a3a8-fc3ea928dd7a', '43fcabee-3bbc-4f79-a7cc-3ca866359774', 'a7b884fe-d85b-4776-bd8b-36d1f2496fb6', '6037ec6d-1510-49d8-9b44-eb8202aa5fbd'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:23:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:23:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:23:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:23:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:23:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:23:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:36 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:23:36 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:37 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.638s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:37 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:23:37 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Deleted volume successfully. Jul 09 14:23:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0ccb1636-9668-4429-ba33-318d2095c433 tempest-TestInstancesWithCinderVolumes-1834154807 None] Lock "cinder-10087aa6-7d34-4da9-b7e8-afd70a21cf06-delete_volume" released by "delete_volume" :: held 3.241s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:23:46 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=7 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:23:47 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=8,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:23:51 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:23:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Flow 'volume_create_manager' (88f633a7-8276-4a3a-96c9-3575151caf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:23:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35334a15-7887-46dc-9b2c-bfa382bfe256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:23:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35334a15-7887-46dc-9b2c-bfa382bfe256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7649f2-63a0-42f1-b2e5-bb386a5bd136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac9edc5935242a3a1da4a83dfecdc65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:23:51Z,use_quota=True,user_id='1722e2d8a5164ab39b3625afe42e3522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(787c7824-1906-4129-8508-a12aca80ec4b),volume_type_id=787c7824-1906-4129-8508-a12aca80ec4b)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:23:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc750a8c-8bd4-4eb2-9378-2858edea8725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:23:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc750a8c-8bd4-4eb2-9378-2858edea8725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:23:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af1f48a-551d-4717-9f32-1b0f9411c599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:23:51 devstack cinder-volume[87011]: DEBUG cinder.image.glance [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Creating Keystone auth plugin from conf {{(pid=87011) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 14:23:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af1f48a-551d-4717-9f32-1b0f9411c599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0a7649f2-63a0-42f1-b2e5-bb386a5bd136', 'volume_name': 'volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136', 'volume_size': 1, 'image_id': '9ad8329f-bb9d-424d-95f8-8dcbf6d6486a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ad8329f-bb9d-424d-95f8-8dcbf6d6486a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '15ff65ee2ed94353d3c4d777c19b446a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aac9edc5935242a3a1da4a83dfecdc65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ca481c06669929ff01f2c50f6d7d7b03aaf7e3047ec32b8b0a48dc9e3b7f746fef5388a307cb9d0a19ba3b253377edc773afa2665f2572c8f16c1bd548c6e08', 'id': '9ad8329f-bb9d-424d-95f8-8dcbf6d6486a', 'created_at': datetime.datetime(2026, 7, 9, 12, 23, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 23, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ad8329f-bb9d-424d-95f8-8dcbf6d6486a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:23:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5277359-71b3-4ddf-a477-207722e35b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:23:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5277359-71b3-4ddf-a477-207722e35b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:23:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf597a5-8007-4883-9230-83f37ba060bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:23:51 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Volume 0a7649f2-63a0-42f1-b2e5-bb386a5bd136: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136', 'volume_size': 1, 'image_id': '9ad8329f-bb9d-424d-95f8-8dcbf6d6486a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ad8329f-bb9d-424d-95f8-8dcbf6d6486a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '15ff65ee2ed94353d3c4d777c19b446a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aac9edc5935242a3a1da4a83dfecdc65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ca481c06669929ff01f2c50f6d7d7b03aaf7e3047ec32b8b0a48dc9e3b7f746fef5388a307cb9d0a19ba3b253377edc773afa2665f2572c8f16c1bd548c6e08', 'id': '9ad8329f-bb9d-424d-95f8-8dcbf6d6486a', 'created_at': datetime.datetime(2026, 7, 9, 12, 23, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 23, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ad8329f-bb9d-424d-95f8-8dcbf6d6486a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 14:23:51 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Trying to clone 0a7649f2-63a0-42f1-b2e5-bb386a5bd136 from image 9ad8329f-bb9d-424d-95f8-8dcbf6d6486a at location (None, [{'url': 'file:///opt/stack/data/glance/images/9ad8329f-bb9d-424d-95f8-8dcbf6d6486a', 'metadata': {}}]). {{(pid=87011) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 14:23:51 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 14:23:51 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Image download 0.00 MB at 0.00 MB/s Jul 09 14:23:51 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e966987-f8a9-493b-bddf-0f44243991fb]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:23:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:51 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD Jul 09 14:23:51 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:52 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD" returned: 0 in 0.770s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:52 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD Jul 09 14:23:52 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:53 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD" returned: 1 in 0.731s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:23:53 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Temporary image 9ad8329f-bb9d-424d-95f8-8dcbf6d6486a is fetched for user 1722e2d8a5164ab39b3625afe42e3522. {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 14:23:53 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[baef736d-806a-4310-a7f9-4d234c0d6691]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:23:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:53 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD Jul 09 14:23:53 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:53 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD" returned: 0 in 0.737s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:54 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD Jul 09 14:23:54 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:54 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD" returned: 1 in 0.774s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:23:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:23:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:23:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7649f2-63a0-42f1-b2e5-bb386a5bd136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac9edc5935242a3a1da4a83dfecdc65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:23:51Z,use_quota=True,user_id='1722e2d8a5164ab39b3625afe42e3522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(787c7824-1906-4129-8508-a12aca80ec4b),volume_type_id=787c7824-1906-4129-8508-a12aca80ec4b)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:23:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Creating volume 0a7649f2-63a0-42f1-b2e5-bb386a5bd136 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:23:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:23:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:23:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:23:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:23:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:23:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:23:54 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:23:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:54 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 1073741824 Jul 09 14:23:54 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:55 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 1073741824" returned: 0 in 0.849s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:55 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 Jul 09 14:23:55 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:56 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136" returned: 0 in 0.696s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:23:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:23:56 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Attempting download of 9ad8329f-bb9d-424d-95f8-8dcbf6d6486a ((None, [{'url': 'file:///opt/stack/data/glance/images/9ad8329f-bb9d-424d-95f8-8dcbf6d6486a', 'metadata': {}}])) to volume 0a7649f2-63a0-42f1-b2e5-bb386a5bd136. {{(pid=87011) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 14:23:56 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b1baf8-b7de-4f05-b61d-e4bb29e72f44]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:23:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_e8c5s6lp {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:56 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_e8c5s6lp Jul 09 14:23:56 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:57 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_e8c5s6lp" returned: 0 in 0.751s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_e8c5s6lp {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:57 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_e8c5s6lp Jul 09 14:23:57 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:57 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_e8c5s6lp" returned: 1 in 0.737s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_e8c5s6lp' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:23:57 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab74ba74-8df2-4020-9327-f8d39fa78b9e]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:23:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:58 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD Jul 09 14:23:58 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:58 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD" returned: 0 in 0.768s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:58 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD Jul 09 14:23:58 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:23:59 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Jul 09 14:23:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD" returned: 1 in 0.713s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:23:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:23:59 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] 9ad8329f-bb9d-424d-95f8-8dcbf6d6486a was raw, converting to raw {{(pid=87011) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 14:23:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:23:59 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 Jul 09 14:23:59 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:00 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136" returned: 0 in 0.757s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:00 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9ad8329f-bb9d-424d-95f8-8dcbf6d6486a_8m87pgkedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:24:00 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 14:24:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:00 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 1G Jul 09 14:24:00 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:00 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 1G" returned: 0 in 0.724s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:00 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe0f1c5-d5c2-403a-a805-1bd3047d460e]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:24:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:01 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 Jul 09 14:24:01 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:01 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136" returned: 0 in 0.769s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:01 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 Jul 09 14:24:01 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:02 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136" returned: 1 in 0.713s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:24:02 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Downloaded image 9ad8329f-bb9d-424d-95f8-8dcbf6d6486a ((None, [{'url': 'file:///opt/stack/data/glance/images/9ad8329f-bb9d-424d-95f8-8dcbf6d6486a', 'metadata': {}}])) to volume 0a7649f2-63a0-42f1-b2e5-bb386a5bd136 successfully. {{(pid=87011) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 14:24:02 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Temporary image 9ad8329f-bb9d-424d-95f8-8dcbf6d6486a for user 1722e2d8a5164ab39b3625afe42e3522 is deleted. {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 14:24:02 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Marking volume 0a7649f2-63a0-42f1-b2e5-bb386a5bd136 as bootable. {{(pid=87011) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 14:24:02 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Copying metadata from image 9ad8329f-bb9d-424d-95f8-8dcbf6d6486a to 0a7649f2-63a0-42f1-b2e5-bb386a5bd136. {{(pid=87011) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 14:24:02 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Creating volume glance metadata for volume 0a7649f2-63a0-42f1-b2e5-bb386a5bd136 backed by image 9ad8329f-bb9d-424d-95f8-8dcbf6d6486a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9ad8329f-bb9d-424d-95f8-8dcbf6d6486a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '15ff65ee2ed94353d3c4d777c19b446a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87011) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 14:24:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf597a5-8007-4883-9230-83f37ba060bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136', 'volume_size': 1, 'image_id': '9ad8329f-bb9d-424d-95f8-8dcbf6d6486a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ad8329f-bb9d-424d-95f8-8dcbf6d6486a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '15ff65ee2ed94353d3c4d777c19b446a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aac9edc5935242a3a1da4a83dfecdc65', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ca481c06669929ff01f2c50f6d7d7b03aaf7e3047ec32b8b0a48dc9e3b7f746fef5388a307cb9d0a19ba3b253377edc773afa2665f2572c8f16c1bd548c6e08', 'id': '9ad8329f-bb9d-424d-95f8-8dcbf6d6486a', 'created_at': datetime.datetime(2026, 7, 9, 12, 23, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 23, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ad8329f-bb9d-424d-95f8-8dcbf6d6486a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a065784-e1ca-4f3b-85e3-c9dcbdae1cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:02 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Volume volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 (0a7649f2-63a0-42f1-b2e5-bb386a5bd136): created successfully Jul 09 14:24:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a065784-e1ca-4f3b-85e3-c9dcbdae1cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:02 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Flow 'volume_create_manager' (88f633a7-8276-4a3a-96c9-3575151caf14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:02 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-64842ad2-89f8-48e3-aab0-e89c1c267c61 tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Created volume successfully. Jul 09 14:24:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Acquiring lock "cinder-0a7649f2-63a0-42f1-b2e5-bb386a5bd136-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Lock "cinder-0a7649f2-63a0-42f1-b2e5-bb386a5bd136-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Acquiring lock "cinder-quobyte-0a7649f2-63a0-42f1-b2e5-bb386a5bd136" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Lock "cinder-quobyte-0a7649f2-63a0-42f1-b2e5-bb386a5bd136" acquired by "delete_volume" :: waited 0.014s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:02 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6017cea-91f6-46fa-be63-d31bc1e76792]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:24:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:03 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 Jul 09 14:24:03 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:03 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136" returned: 0 in 0.741s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:03 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 Jul 09 14:24:03 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:04 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136" returned: 1 in 0.698s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:24:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:04 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136 Jul 09 14:24:04 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:05 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0a7649f2-63a0-42f1-b2e5-bb386a5bd136" returned: 0 in 0.613s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:05 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Lock "cinder-quobyte-0a7649f2-63a0-42f1-b2e5-bb386a5bd136" released by "delete_volume" :: held 2.111s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:05 devstack cinder-volume[87011]: WARNING cinder.quota [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:24:05 devstack cinder-volume[87011]: WARNING cinder.quota [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 14:24:05 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Created reservations ['e4d8218a-642f-4c73-b555-1649cf1dc585', '7b8dbe6a-403d-4e86-a60e-652fdcc9e3e1', '465e8251-dc11-4d8f-bb57-658d4d32cc95', '3f90bc62-c2ca-4bc3-aacc-1f744217d7f6'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:24:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:05 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:24:05 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:05 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.616s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:05 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:24:05 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Deleted volume successfully. Jul 09 14:24:05 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9a6675f9-28bc-412d-8a3a-fca887a84a8a tempest-VolumeAndVolumeTypeFromImageTest-1787561713 None] Lock "cinder-0a7649f2-63a0-42f1-b2e5-bb386a5bd136-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Flow 'volume_create_manager' (c10ec8d6-58ae-41a4-963a-89f8876e6b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c7f183-b771-43c9-84d4-6f7aa0af88b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c7f183-b771-43c9-84d4-6f7aa0af88b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-509840659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47da1301-3a71-45d4-b5de-ece732160e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc69753c6cc4b36aaadfb20ad9045f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:10Z,use_quota=True,user_id='19986d8849994994a32f6f51ea627e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d3cf96-b22c-4f95-84ab-79cd0fbd3793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d3cf96-b22c-4f95-84ab-79cd0fbd3793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20f5a23-1334-4a32-a817-90a272b84398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20f5a23-1334-4a32-a817-90a272b84398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47da1301-3a71-45d4-b5de-ece732160e2c', 'volume_name': 'volume-47da1301-3a71-45d4-b5de-ece732160e2c', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c2535a-c934-4b4f-957a-ae5ef3051c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c2535a-c934-4b4f-957a-ae5ef3051c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60fb09e5-8932-4ad2-ade1-400820a6a16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:10 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Volume 47da1301-3a71-45d4-b5de-ece732160e2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47da1301-3a71-45d4-b5de-ece732160e2c', 'volume_size': 1} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-509840659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47da1301-3a71-45d4-b5de-ece732160e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc69753c6cc4b36aaadfb20ad9045f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:10Z,use_quota=True,user_id='19986d8849994994a32f6f51ea627e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Creating volume 47da1301-3a71-45d4-b5de-ece732160e2c {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:24:10 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-47da1301-3a71-45d4-b5de-ece732160e2c 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:10 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-47da1301-3a71-45d4-b5de-ece732160e2c 1073741824 Jul 09 14:24:10 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Flow 'volume_create_manager' (21997b7a-84e7-456a-91f6-a56be0902543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b1b1af-8858-4911-b426-832c47ce4dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b1b1af-8858-4911-b426-832c47ce4dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1988248777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc99907d-efb7-4399-bd7f-2856f85e2215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc69753c6cc4b36aaadfb20ad9045f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:11Z,use_quota=True,user_id='19986d8849994994a32f6f51ea627e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54714d3-d52f-4426-83aa-35d18feee3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54714d3-d52f-4426-83aa-35d18feee3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ccaad7-5b40-4301-ade0-0e7d14c2c54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ccaad7-5b40-4301-ade0-0e7d14c2c54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc99907d-efb7-4399-bd7f-2856f85e2215', 'volume_name': 'volume-bc99907d-efb7-4399-bd7f-2856f85e2215', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5650f330-d060-4024-9817-0353b05fc2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5650f330-d060-4024-9817-0353b05fc2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e448be66-dd12-4452-8b66-aac4ee3aa8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:10 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Volume bc99907d-efb7-4399-bd7f-2856f85e2215: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc99907d-efb7-4399-bd7f-2856f85e2215', 'volume_size': 1} Jul 09 14:24:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Flow 'volume_create_manager' (1bf484a6-73b6-48a0-af69-46ecc53a28c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d2345e-b561-439d-a078-957bd89eceb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d2345e-b561-439d-a078-957bd89eceb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1622102316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc69753c6cc4b36aaadfb20ad9045f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:11Z,use_quota=True,user_id='19986d8849994994a32f6f51ea627e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77b966f-5bd9-44d7-a61b-fb9a56a2c8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77b966f-5bd9-44d7-a61b-fb9a56a2c8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb35054-dc8d-495f-80d3-8cccca6349d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cb35054-dc8d-495f-80d3-8cccca6349d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a', 'volume_name': 'volume-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf94183-26ec-4687-9b5b-8315c7644e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf94183-26ec-4687-9b5b-8315c7644e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204c87e7-958b-4b95-9555-9bad28176287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:11 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Volume ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a', 'volume_size': 1} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:11 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-47da1301-3a71-45d4-b5de-ece732160e2c 1073741824" returned: 0 in 1.193s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-47da1301-3a71-45d4-b5de-ece732160e2c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:11 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-47da1301-3a71-45d4-b5de-ece732160e2c Jul 09 14:24:11 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Flow 'volume_create_manager' (c327964f-eea3-4b48-9ec1-628a0b8028be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56bcbed-7a07-408b-9e42-58a0f5617ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b56bcbed-7a07-408b-9e42-58a0f5617ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1867172896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3596788b-3b99-452d-ae0b-7b7d09929cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc69753c6cc4b36aaadfb20ad9045f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:12Z,use_quota=True,user_id='19986d8849994994a32f6f51ea627e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687e5907-a430-4dfc-bf3e-d8ce81aa5764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687e5907-a430-4dfc-bf3e-d8ce81aa5764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5321ef35-5d73-49d3-a618-291593a882c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5321ef35-5d73-49d3-a618-291593a882c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3596788b-3b99-452d-ae0b-7b7d09929cd0', 'volume_name': 'volume-3596788b-3b99-452d-ae0b-7b7d09929cd0', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e900b3-1159-44ff-84d4-7a61708be6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e900b3-1159-44ff-84d4-7a61708be6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75dbda5d-9572-48ae-ae28-5c1401c4d7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:11 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Volume 3596788b-3b99-452d-ae0b-7b7d09929cd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3596788b-3b99-452d-ae0b-7b7d09929cd0', 'volume_size': 1} Jul 09 14:24:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Flow 'volume_create_manager' (a882527c-3f9e-487b-8313-767c457d7848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f108cf92-e3bc-4a8a-9a28-12700cf8742f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f108cf92-e3bc-4a8a-9a28-12700cf8742f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-810840184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3484f418-5c8f-4fc5-b9a4-90701504b5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc69753c6cc4b36aaadfb20ad9045f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:12Z,use_quota=True,user_id='19986d8849994994a32f6f51ea627e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951752bd-5c21-4066-aa49-fde095c8fa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951752bd-5c21-4066-aa49-fde095c8fa1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a215d2d-6e66-4e7c-a461-3cbecddbda29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a215d2d-6e66-4e7c-a461-3cbecddbda29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3484f418-5c8f-4fc5-b9a4-90701504b5cc', 'volume_name': 'volume-3484f418-5c8f-4fc5-b9a4-90701504b5cc', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a425fd-9c24-4460-b514-6fb3002fe963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a425fd-9c24-4460-b514-6fb3002fe963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2dde6dc-f08e-484d-990d-c7f84bca1170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:12 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Volume 3484f418-5c8f-4fc5-b9a4-90701504b5cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3484f418-5c8f-4fc5-b9a4-90701504b5cc', 'volume_size': 1} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:12 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:24:12 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:12 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-47da1301-3a71-45d4-b5de-ece732160e2c" returned: 0 in 0.953s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] <== create_volume: return (2198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.779s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1988248777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc99907d-efb7-4399-bd7f-2856f85e2215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc69753c6cc4b36aaadfb20ad9045f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:11Z,use_quota=True,user_id='19986d8849994994a32f6f51ea627e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Creating volume bc99907d-efb7-4399-bd7f-2856f85e2215 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:24:12 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc99907d-efb7-4399-bd7f-2856f85e2215 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60fb09e5-8932-4ad2-ade1-400820a6a16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47da1301-3a71-45d4-b5de-ece732160e2c', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:12 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc99907d-efb7-4399-bd7f-2856f85e2215 1073741824 Jul 09 14:24:12 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4195a02d-3058-4e39-976a-97b241f33c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:12 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Volume volume-47da1301-3a71-45d4-b5de-ece732160e2c (47da1301-3a71-45d4-b5de-ece732160e2c): created successfully Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4195a02d-3058-4e39-976a-97b241f33c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Flow 'volume_create_manager' (c10ec8d6-58ae-41a4-963a-89f8876e6b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:12 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-870abce5-a88f-4e02-80e1-d32fe7bdb07c tempest-CreateVolumesFromImageTest-1036745863 None] Created volume successfully. Jul 09 14:24:13 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.714s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:24:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:24:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:24:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:24:13 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc99907d-efb7-4399-bd7f-2856f85e2215 1073741824" returned: 0 in 0.916s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc99907d-efb7-4399-bd7f-2856f85e2215 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:13 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc99907d-efb7-4399-bd7f-2856f85e2215 Jul 09 14:24:13 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:14 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-6c68437f-d704-4e96-b006-f2be93b45024 req-fde16383-61de-416f-9948-03b88c32006a tempest-TestMinimumBasicScenario-119390099 None] Terminate volume connection completed successfully. Jul 09 14:24:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-6c68437f-d704-4e96-b006-f2be93b45024 req-fde16383-61de-416f-9948-03b88c32006a tempest-TestMinimumBasicScenario-119390099 None] Deleting attachment c0ef54fb-c118-42a0-b787-31475090e170. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:24:14 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc99907d-efb7-4399-bd7f-2856f85e2215" returned: 0 in 0.717s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:24:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.061s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1622102316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc69753c6cc4b36aaadfb20ad9045f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:11Z,use_quota=True,user_id='19986d8849994994a32f6f51ea627e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:24:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Creating volume ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:24:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:24:14 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:24:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e448be66-dd12-4452-8b66-aac4ee3aa8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc99907d-efb7-4399-bd7f-2856f85e2215', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:14 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a 1073741824 Jul 09 14:24:14 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fddd49f-77ba-464c-a661-24a8e4d1a1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:14 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Volume volume-bc99907d-efb7-4399-bd7f-2856f85e2215 (bc99907d-efb7-4399-bd7f-2856f85e2215): created successfully Jul 09 14:24:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fddd49f-77ba-464c-a661-24a8e4d1a1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Flow 'volume_create_manager' (21997b7a-84e7-456a-91f6-a56be0902543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:14 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-6bfd99da-f1f5-4e68-b1a3-cc76d7ea8aa1 tempest-CreateVolumesFromImageTest-1036745863 None] Created volume successfully. Jul 09 14:24:15 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a 1073741824" returned: 0 in 0.837s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:15 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a Jul 09 14:24:15 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:15 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a" returned: 0 in 0.644s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:24:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.997s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1867172896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3596788b-3b99-452d-ae0b-7b7d09929cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc69753c6cc4b36aaadfb20ad9045f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:12Z,use_quota=True,user_id='19986d8849994994a32f6f51ea627e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:24:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Creating volume 3596788b-3b99-452d-ae0b-7b7d09929cd0 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:24:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:24:15 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:24:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3596788b-3b99-452d-ae0b-7b7d09929cd0 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:15 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3596788b-3b99-452d-ae0b-7b7d09929cd0 1073741824 Jul 09 14:24:15 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (204c87e7-958b-4b95-9555-9bad28176287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0572febb-98b6-4cbc-a9a8-2d06788a5fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:16 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Volume volume-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a (ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a): created successfully Jul 09 14:24:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0572febb-98b6-4cbc-a9a8-2d06788a5fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Flow 'volume_create_manager' (1bf484a6-73b6-48a0-af69-46ecc53a28c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:16 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-40773be8-1ae6-4ea4-9a88-f906f600ecb3 tempest-CreateVolumesFromImageTest-1036745863 None] Created volume successfully. Jul 09 14:24:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] Acquiring lock "cinder-49ef4b5e-4839-490d-ae97-837b64d90eb3-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] Lock "cinder-49ef4b5e-4839-490d-ae97-837b64d90eb3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] Acquiring lock "cinder-quobyte-49ef4b5e-4839-490d-ae97-837b64d90eb3" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] Lock "cinder-quobyte-49ef4b5e-4839-490d-ae97-837b64d90eb3" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:16 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b286248-67fc-46d8-8639-429b433c6759]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:24:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-49ef4b5e-4839-490d-ae97-837b64d90eb3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:16 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-49ef4b5e-4839-490d-ae97-837b64d90eb3 Jul 09 14:24:16 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:16 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3596788b-3b99-452d-ae0b-7b7d09929cd0 1073741824" returned: 0 in 0.903s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3596788b-3b99-452d-ae0b-7b7d09929cd0 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:16 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3596788b-3b99-452d-ae0b-7b7d09929cd0 Jul 09 14:24:16 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:17 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-49ef4b5e-4839-490d-ae97-837b64d90eb3" returned: 0 in 0.770s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-49ef4b5e-4839-490d-ae97-837b64d90eb3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:17 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-49ef4b5e-4839-490d-ae97-837b64d90eb3 Jul 09 14:24:17 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:17 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3596788b-3b99-452d-ae0b-7b7d09929cd0" returned: 0 in 0.667s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.271s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-810840184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3484f418-5c8f-4fc5-b9a4-90701504b5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc69753c6cc4b36aaadfb20ad9045f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:12Z,use_quota=True,user_id='19986d8849994994a32f6f51ea627e0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Creating volume 3484f418-5c8f-4fc5-b9a4-90701504b5cc {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:24:17 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3484f418-5c8f-4fc5-b9a4-90701504b5cc 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:17 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3484f418-5c8f-4fc5-b9a4-90701504b5cc 1073741824 Jul 09 14:24:17 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75dbda5d-9572-48ae-ae28-5c1401c4d7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3596788b-3b99-452d-ae0b-7b7d09929cd0', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb83e8bf-5ddd-4cff-9f6e-185553b46d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:17 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Volume volume-3596788b-3b99-452d-ae0b-7b7d09929cd0 (3596788b-3b99-452d-ae0b-7b7d09929cd0): created successfully Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb83e8bf-5ddd-4cff-9f6e-185553b46d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Flow 'volume_create_manager' (c327964f-eea3-4b48-9ec1-628a0b8028be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:17 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-7567eada-6c99-4367-b8e0-ea479b3790b3 tempest-CreateVolumesFromImageTest-1036745863 None] Created volume successfully. Jul 09 14:24:17 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-49ef4b5e-4839-490d-ae97-837b64d90eb3" returned: 0 in 0.681s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] Lock "cinder-quobyte-49ef4b5e-4839-490d-ae97-837b64d90eb3" released by "delete_volume" :: held 1.510s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:17 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] Created reservations ['bafb8a47-ef3f-46c4-9e5a-4e71cc0aefbf', '523a71e7-f473-4b94-bd48-170c99525b2d', 'a0a68e30-93c5-47a4-8c87-16539fa48be5', '948d8965-73a4-48ca-af11-5afcf383208b'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:24:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:18 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:24:18 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:18 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3484f418-5c8f-4fc5-b9a4-90701504b5cc 1073741824" returned: 0 in 0.851s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3484f418-5c8f-4fc5-b9a4-90701504b5cc {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:18 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3484f418-5c8f-4fc5-b9a4-90701504b5cc Jul 09 14:24:18 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:18 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.748s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:18 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:24:18 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] Deleted volume successfully. Jul 09 14:24:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-88f783dc-87f2-4803-9d11-ad2812621402 tempest-TestMinimumBasicScenario-119390099 None] Lock "cinder-49ef4b5e-4839-490d-ae97-837b64d90eb3-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:19 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3484f418-5c8f-4fc5-b9a4-90701504b5cc" returned: 0 in 0.756s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:24:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2dde6dc-f08e-484d-990d-c7f84bca1170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3484f418-5c8f-4fc5-b9a4-90701504b5cc', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d497ed-8d40-4c02-9e52-36f5187cf5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:19 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Volume volume-3484f418-5c8f-4fc5-b9a4-90701504b5cc (3484f418-5c8f-4fc5-b9a4-90701504b5cc): created successfully Jul 09 14:24:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d497ed-8d40-4c02-9e52-36f5187cf5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Flow 'volume_create_manager' (a882527c-3f9e-487b-8313-767c457d7848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:19 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-7e78ed56-16c3-4f55-bd61-22d95d995b73 tempest-CreateVolumesFromImageTest-1036745863 None] Created volume successfully. Jul 09 14:24:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "cinder-3484f418-5c8f-4fc5-b9a4-90701504b5cc-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-3484f418-5c8f-4fc5-b9a4-90701504b5cc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "cinder-quobyte-3484f418-5c8f-4fc5-b9a4-90701504b5cc" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-quobyte-3484f418-5c8f-4fc5-b9a4-90701504b5cc" acquired by "delete_volume" :: waited 0.012s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:19 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdbae76-0ac4-49ec-b1ba-37de2f0de466]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:24:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3484f418-5c8f-4fc5-b9a4-90701504b5cc {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:20 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3484f418-5c8f-4fc5-b9a4-90701504b5cc Jul 09 14:24:20 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:20 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3484f418-5c8f-4fc5-b9a4-90701504b5cc" returned: 0 in 0.881s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3484f418-5c8f-4fc5-b9a4-90701504b5cc {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:20 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3484f418-5c8f-4fc5-b9a4-90701504b5cc Jul 09 14:24:20 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:21 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3484f418-5c8f-4fc5-b9a4-90701504b5cc" returned: 0 in 0.667s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-quobyte-3484f418-5c8f-4fc5-b9a4-90701504b5cc" released by "delete_volume" :: held 1.585s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:21 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] Created reservations ['0bfd4a41-7b81-42ee-a5fd-dba069c29a60', 'e7532159-bdee-4b42-9c50-3b02bdb064ad', '6cde181c-dd80-43e2-bb57-e75aaec51777', '8c914630-011e-4d24-8b14-218effcbca2e'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:24:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:21 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:24:21 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "cinder-3596788b-3b99-452d-ae0b-7b7d09929cd0-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-3596788b-3b99-452d-ae0b-7b7d09929cd0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "cinder-quobyte-3596788b-3b99-452d-ae0b-7b7d09929cd0" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-quobyte-3596788b-3b99-452d-ae0b-7b7d09929cd0" acquired by "delete_volume" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:22 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[630ff5b6-4bff-4a63-b986-73e6d654b251]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:24:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3596788b-3b99-452d-ae0b-7b7d09929cd0 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:22 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3596788b-3b99-452d-ae0b-7b7d09929cd0 Jul 09 14:24:22 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:22 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.642s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:22 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:24:22 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] Deleted volume successfully. Jul 09 14:24:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-09340988-db3c-422b-b6d3-4548ab5d2998 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-3484f418-5c8f-4fc5-b9a4-90701504b5cc-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:22 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3596788b-3b99-452d-ae0b-7b7d09929cd0" returned: 0 in 0.744s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3596788b-3b99-452d-ae0b-7b7d09929cd0 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:22 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3596788b-3b99-452d-ae0b-7b7d09929cd0 Jul 09 14:24:22 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:23 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3596788b-3b99-452d-ae0b-7b7d09929cd0" returned: 0 in 0.614s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:23 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-quobyte-3596788b-3b99-452d-ae0b-7b7d09929cd0" released by "delete_volume" :: held 1.413s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:23 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] Created reservations ['14db61e6-7493-48ec-9989-69dc564d3710', '70301adc-c663-409b-9e1e-d9c478d0e4ca', '533af996-1aaa-49a3-8961-5a8e3ba43475', 'f8255d54-ab78-4dfd-ab92-a27139c830f6'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:24:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:23 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:24:23 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:24 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.644s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:24 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:24:24 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] Deleted volume successfully. Jul 09 14:24:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "cinder-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-28aa28db-6b5e-4ea8-8cc6-bf446c596527 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-3596788b-3b99-452d-ae0b-7b7d09929cd0-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "cinder-quobyte-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-quobyte-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a" acquired by "delete_volume" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:24 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3510ab-e84f-4994-9604-aef95837ad16]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:24:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:24 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a Jul 09 14:24:24 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:25 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a" returned: 0 in 0.753s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:25 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a Jul 09 14:24:25 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:25 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a" returned: 0 in 0.635s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:25 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-quobyte-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a" released by "delete_volume" :: held 1.430s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:25 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] Created reservations ['3af424f1-ddaa-47b9-99d5-4c119b9cd127', 'cf07fb6f-e132-4821-b2fb-874705b60bc0', '14e04a06-de99-44d9-8ca3-1e13e81d1036', 'fabe92d2-14c1-4640-9bfb-f861163cb9f8'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:24:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:26 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:24:26 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "cinder-bc99907d-efb7-4399-bd7f-2856f85e2215-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-bc99907d-efb7-4399-bd7f-2856f85e2215-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "cinder-quobyte-bc99907d-efb7-4399-bd7f-2856f85e2215" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:26 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-quobyte-bc99907d-efb7-4399-bd7f-2856f85e2215" acquired by "delete_volume" :: waited 0.031s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.734s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:26 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:24:26 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] Deleted volume successfully. Jul 09 14:24:26 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed0a537-98ed-4706-8bae-a384639653bf]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:24:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc99907d-efb7-4399-bd7f-2856f85e2215 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f2eec719-5bdb-4d72-bf9b-537c0f85f1dd tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-ce82eb10-4fe9-4d46-9ac0-d3654fb8fe3a-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:26 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc99907d-efb7-4399-bd7f-2856f85e2215 Jul 09 14:24:26 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:27 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc99907d-efb7-4399-bd7f-2856f85e2215" returned: 0 in 0.797s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc99907d-efb7-4399-bd7f-2856f85e2215 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:27 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc99907d-efb7-4399-bd7f-2856f85e2215 Jul 09 14:24:27 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:28 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-bc99907d-efb7-4399-bd7f-2856f85e2215" returned: 0 in 0.681s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:28 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-quobyte-bc99907d-efb7-4399-bd7f-2856f85e2215" released by "delete_volume" :: held 1.529s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:28 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] Created reservations ['23e51e90-dfd5-496e-947f-8cd8cae73f96', 'a5f39814-6ce5-4754-ae4c-71691fb40ecf', 'e4400205-65ca-43c2-8a83-2fc25505be8a', '7301370d-45f6-4343-b30d-fa66133af110'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:24:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:28 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:24:28 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:28 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "cinder-47da1301-3a71-45d4-b5de-ece732160e2c-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:28 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-47da1301-3a71-45d4-b5de-ece732160e2c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "cinder-quobyte-47da1301-3a71-45d4-b5de-ece732160e2c" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-quobyte-47da1301-3a71-45d4-b5de-ece732160e2c" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:29 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0f1fe4-be2f-4fb0-9c34-57583d1f0b73]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:24:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-47da1301-3a71-45d4-b5de-ece732160e2c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:29 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.726s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:29 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:24:29 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] Deleted volume successfully. Jul 09 14:24:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4f0e41f3-6a8b-4606-a0cc-f6416b52cd81 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-bc99907d-efb7-4399-bd7f-2856f85e2215-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:29 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-47da1301-3a71-45d4-b5de-ece732160e2c Jul 09 14:24:29 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:29 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-47da1301-3a71-45d4-b5de-ece732160e2c" returned: 0 in 0.793s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-47da1301-3a71-45d4-b5de-ece732160e2c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:29 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-47da1301-3a71-45d4-b5de-ece732160e2c Jul 09 14:24:29 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:30 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-47da1301-3a71-45d4-b5de-ece732160e2c" returned: 0 in 0.639s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-quobyte-47da1301-3a71-45d4-b5de-ece732160e2c" released by "delete_volume" :: held 1.480s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:30 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] Created reservations ['5614dbb8-94a5-4ff9-b046-b2402aa43f38', 'aa75ae55-0363-49a5-b8d0-779d77a8bc11', '3b458fa7-1ebf-4b1d-956c-a8c12231d536', '76855485-6f68-4d59-bf27-fcc7a6402b1d'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:24:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:30 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:30 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:30 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:24:30 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:31 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.694s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:31 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:24:31 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] Deleted volume successfully. Jul 09 14:24:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-327d6f58-e4e8-4e98-b849-f979c4341f71 tempest-CreateVolumesFromImageTest-1036745863 None] Lock "cinder-47da1301-3a71-45d4-b5de-ece732160e2c-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Flow 'volume_create_manager' (a04d16b3-8da9-4c5c-99f0-2029cfe96e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d4e446-a9ee-411e-8843-217a451c937b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d4e446-a9ee-411e-8843-217a451c937b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-957463983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be50f12a-e0af-4c3d-a927-dca84e337d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec2ea5a09df4bf898b8bbf995deaa61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:35Z,use_quota=True,user_id='2429387f875e400fbd1b4725479cc952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73985fbd-e641-448a-bd67-174f85e143db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73985fbd-e641-448a-bd67-174f85e143db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767e5bc0-dcc3-4fd4-b675-afd2e9fd0062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767e5bc0-dcc3-4fd4-b675-afd2e9fd0062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be50f12a-e0af-4c3d-a927-dca84e337d8e', 'volume_name': 'volume-be50f12a-e0af-4c3d-a927-dca84e337d8e', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3350149e-e673-4bc5-836b-eb9275d30e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3350149e-e673-4bc5-836b-eb9275d30e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ee99a7-c678-4a11-b8e1-1ff1299b061a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:34 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Volume be50f12a-e0af-4c3d-a927-dca84e337d8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be50f12a-e0af-4c3d-a927-dca84e337d8e', 'volume_size': 1} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-957463983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be50f12a-e0af-4c3d-a927-dca84e337d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec2ea5a09df4bf898b8bbf995deaa61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:35Z,use_quota=True,user_id='2429387f875e400fbd1b4725479cc952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Creating volume be50f12a-e0af-4c3d-a927-dca84e337d8e {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:24:34 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:24:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:34 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e 1073741824 Jul 09 14:24:34 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:35 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e 1073741824" returned: 0 in 0.822s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:35 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e Jul 09 14:24:35 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:36 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e" returned: 0 in 0.650s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:24:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ee99a7-c678-4a11-b8e1-1ff1299b061a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be50f12a-e0af-4c3d-a927-dca84e337d8e', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb67f30-5d28-4595-ab41-48817a79d4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:36 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Volume volume-be50f12a-e0af-4c3d-a927-dca84e337d8e (be50f12a-e0af-4c3d-a927-dca84e337d8e): created successfully Jul 09 14:24:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb67f30-5d28-4595-ab41-48817a79d4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Flow 'volume_create_manager' (a04d16b3-8da9-4c5c-99f0-2029cfe96e0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:36 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-75f42d87-833e-4125-991c-520559f58d68 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Created volume successfully. Jul 09 14:24:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Creating offline snapshot 6464415c-1b85-4299-a048-f301ea3afa11 of volume be50f12a-e0af-4c3d-a927-dca84e337d8e {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:24:36 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[554dae43-1961-411b-8316-da1896e11c90]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:24:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:37 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e Jul 09 14:24:37 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:37 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e" returned: 0 in 0.753s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:37 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11 1G Jul 09 14:24:37 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:38 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11 1G" returned: 0 in 0.772s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be50f12a-e0af-4c3d-a927-dca84e337d8e -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:38 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be50f12a-e0af-4c3d-a927-dca84e337d8e -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11 Jul 09 14:24:38 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:39 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be50f12a-e0af-4c3d-a927-dca84e337d8e -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11" returned: 0 in 0.741s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:39 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11 is being set with open permissions: ugo+rw Jul 09 14:24:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:39 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11 Jul 09 14:24:39 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:39 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11" returned: 0 in 0.629s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:39 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.info Jul 09 14:24:39 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:40 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.info" returned: 0 in 0.664s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:40 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.info is being set with open permissions: ugo+rw Jul 09 14:24:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:40 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.info Jul 09 14:24:40 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:41 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.info" returned: 0 in 0.651s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.314s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:41 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-994a1d64-2c94-4c48-bd93-b48102186020 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Create snapshot completed successfully Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Flow 'volume_create_manager' (fe6ce8a4-690f-4a17-8351-e98a4f873049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efacaefc-921d-4d87-b772-98b2be7f3778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efacaefc-921d-4d87-b772-98b2be7f3778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2128753409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26249eb-4597-4603-ba36-d593e169a2b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec2ea5a09df4bf898b8bbf995deaa61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:43Z,use_quota=True,user_id='2429387f875e400fbd1b4725479cc952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c332c2-12c9-4598-809d-65b2845a7977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c332c2-12c9-4598-809d-65b2845a7977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd3db70-293c-4a94-8051-dcf50cd89bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd3db70-293c-4a94-8051-dcf50cd89bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd26249eb-4597-4603-ba36-d593e169a2b5', 'volume_name': 'volume-d26249eb-4597-4603-ba36-d593e169a2b5', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b75ec24-be1a-4e68-bcb2-4cdf0d266e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b75ec24-be1a-4e68-bcb2-4cdf0d266e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a94f7d2f-ad44-410a-b37d-49939db09840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:42 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Volume d26249eb-4597-4603-ba36-d593e169a2b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d26249eb-4597-4603-ba36-d593e169a2b5', 'volume_size': 1} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2128753409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26249eb-4597-4603-ba36-d593e169a2b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec2ea5a09df4bf898b8bbf995deaa61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:43Z,use_quota=True,user_id='2429387f875e400fbd1b4725479cc952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Creating volume d26249eb-4597-4603-ba36-d593e169a2b5 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:24:42 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:24:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d26249eb-4597-4603-ba36-d593e169a2b5 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:42 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d26249eb-4597-4603-ba36-d593e169a2b5 1073741824 Jul 09 14:24:42 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Flow 'volume_create_manager' (e2379c58-6c56-432a-bd19-685f0aa7e5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0f28fe-8ca3-49df-9dc8-d32213f97380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0f28fe-8ca3-49df-9dc8-d32213f97380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1229883998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7689d1d-5a35-4313-a70d-263b707a0f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec2ea5a09df4bf898b8bbf995deaa61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:43Z,use_quota=True,user_id='2429387f875e400fbd1b4725479cc952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db5e42e-e273-4d3f-9c2f-eb38469ee4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6db5e42e-e273-4d3f-9c2f-eb38469ee4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f208f094-5627-4266-ab60-7cad7b1527f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f208f094-5627-4266-ab60-7cad7b1527f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7689d1d-5a35-4313-a70d-263b707a0f83', 'volume_name': 'volume-c7689d1d-5a35-4313-a70d-263b707a0f83', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c467b1a-144c-4a78-856a-ec0e4502f82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c467b1a-144c-4a78-856a-ec0e4502f82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b6ab85-5158-441f-8838-07f987bbd54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:43 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Volume c7689d1d-5a35-4313-a70d-263b707a0f83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7689d1d-5a35-4313-a70d-263b707a0f83', 'volume_size': 1} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Flow 'volume_create_manager' (e87401f2-8ce3-4555-8c9f-defa859eef66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed9df9f-1dce-4038-b657-037b30396cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed9df9f-1dce-4038-b657-037b30396cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-70370368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7893332d-4ca4-4362-8807-e24f2ea40c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec2ea5a09df4bf898b8bbf995deaa61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:44Z,use_quota=True,user_id='2429387f875e400fbd1b4725479cc952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab72e2b2-8da0-4323-9588-4bfda98f24c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab72e2b2-8da0-4323-9588-4bfda98f24c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c4ef68-e5a9-43a8-b375-e7fa145168e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c4ef68-e5a9-43a8-b375-e7fa145168e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7893332d-4ca4-4362-8807-e24f2ea40c04', 'volume_name': 'volume-7893332d-4ca4-4362-8807-e24f2ea40c04', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9724e6a5-f02f-4d8e-9368-b74c2ba077ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9724e6a5-f02f-4d8e-9368-b74c2ba077ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2984a03-f315-4d88-9bb4-d8fc76c4df3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:44 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Volume 7893332d-4ca4-4362-8807-e24f2ea40c04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7893332d-4ca4-4362-8807-e24f2ea40c04', 'volume_size': 1} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d26249eb-4597-4603-ba36-d593e169a2b5 1073741824" returned: 0 in 1.493s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:44 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Flow 'volume_create_manager' (12b9875f-63af-4906-b8da-1a5bf3655feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e08e792-bf8d-4bab-832a-e664c5dd4dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d26249eb-4597-4603-ba36-d593e169a2b5 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e08e792-bf8d-4bab-832a-e664c5dd4dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1613042015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f556b7-9f42-4658-9497-e514ed2db681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec2ea5a09df4bf898b8bbf995deaa61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:44Z,use_quota=True,user_id='2429387f875e400fbd1b4725479cc952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:44 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d26249eb-4597-4603-ba36-d593e169a2b5 Jul 09 14:24:44 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac5877d-81fe-4b7d-8848-c2be4ad7ca8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac5877d-81fe-4b7d-8848-c2be4ad7ca8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092a9a72-61ed-4162-bdd1-25fd24f54c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092a9a72-61ed-4162-bdd1-25fd24f54c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71f556b7-9f42-4658-9497-e514ed2db681', 'volume_name': 'volume-71f556b7-9f42-4658-9497-e514ed2db681', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77af214-d55c-44d7-9a2d-2e124a58283c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e77af214-d55c-44d7-9a2d-2e124a58283c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe597a7f-69e9-40bb-a610-2a8cf78cb0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:44 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Volume 71f556b7-9f42-4658-9497-e514ed2db681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71f556b7-9f42-4658-9497-e514ed2db681', 'volume_size': 1} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Flow 'volume_create_manager' (00f39d75-72c2-4239-b4d9-9a7696074d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec5be6d-1c67-4467-a542-519120e54453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec5be6d-1c67-4467-a542-519120e54453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1741028000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a000eee-9945-406c-ae7a-3694938f438a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec2ea5a09df4bf898b8bbf995deaa61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:45Z,use_quota=True,user_id='2429387f875e400fbd1b4725479cc952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70fd0d1-092a-4ee1-8089-0d9dbbf8b5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70fd0d1-092a-4ee1-8089-0d9dbbf8b5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae8dfd66-9a77-4598-a64a-f1a703091639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae8dfd66-9a77-4598-a64a-f1a703091639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a000eee-9945-406c-ae7a-3694938f438a', 'volume_name': 'volume-1a000eee-9945-406c-ae7a-3694938f438a', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de0c599-1713-4c2d-a485-9b4aaa2571e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7de0c599-1713-4c2d-a485-9b4aaa2571e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da8cd370-cbf3-4706-85a9-4f2c5de4e592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:45 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Volume 1a000eee-9945-406c-ae7a-3694938f438a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a000eee-9945-406c-ae7a-3694938f438a', 'volume_size': 1} Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:45 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d26249eb-4597-4603-ba36-d593e169a2b5" returned: 0 in 0.778s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] <== create_volume: return (2398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.401s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.754s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1229883998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7689d1d-5a35-4313-a70d-263b707a0f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec2ea5a09df4bf898b8bbf995deaa61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:43Z,use_quota=True,user_id='2429387f875e400fbd1b4725479cc952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Creating volume c7689d1d-5a35-4313-a70d-263b707a0f83 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:24:45 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c7689d1d-5a35-4313-a70d-263b707a0f83 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:45 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c7689d1d-5a35-4313-a70d-263b707a0f83 1073741824 Jul 09 14:24:45 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a94f7d2f-ad44-410a-b37d-49939db09840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d26249eb-4597-4603-ba36-d593e169a2b5', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65da7a03-67aa-4a75-a8bd-8f3af557c812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:45 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Volume volume-d26249eb-4597-4603-ba36-d593e169a2b5 (d26249eb-4597-4603-ba36-d593e169a2b5): created successfully Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65da7a03-67aa-4a75-a8bd-8f3af557c812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Flow 'volume_create_manager' (fe6ce8a4-690f-4a17-8351-e98a4f873049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:45 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-588cde4a-5a89-4ef0-ab9c-8882bc284435 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Created volume successfully. Jul 09 14:24:46 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c7689d1d-5a35-4313-a70d-263b707a0f83 1073741824" returned: 0 in 0.887s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c7689d1d-5a35-4313-a70d-263b707a0f83 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:46 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c7689d1d-5a35-4313-a70d-263b707a0f83 Jul 09 14:24:46 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:46 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c7689d1d-5a35-4313-a70d-263b707a0f83" returned: 0 in 0.663s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.777s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-70370368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7893332d-4ca4-4362-8807-e24f2ea40c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec2ea5a09df4bf898b8bbf995deaa61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:44Z,use_quota=True,user_id='2429387f875e400fbd1b4725479cc952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Creating volume 7893332d-4ca4-4362-8807-e24f2ea40c04 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:24:46 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7893332d-4ca4-4362-8807-e24f2ea40c04 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=80,cinder:SELECT=65,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:24:46 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7893332d-4ca4-4362-8807-e24f2ea40c04 1073741824 Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b6ab85-5158-441f-8838-07f987bbd54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7689d1d-5a35-4313-a70d-263b707a0f83', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:46 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eaba477-3527-44ad-9462-52f860d2ad12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:46 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Volume volume-c7689d1d-5a35-4313-a70d-263b707a0f83 (c7689d1d-5a35-4313-a70d-263b707a0f83): created successfully Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eaba477-3527-44ad-9462-52f860d2ad12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Flow 'volume_create_manager' (e2379c58-6c56-432a-bd19-685f0aa7e5c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:46 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-e17e4c85-7ed1-4181-919d-64585d55654f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Created volume successfully. Jul 09 14:24:47 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7893332d-4ca4-4362-8807-e24f2ea40c04 1073741824" returned: 0 in 0.860s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:47 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=68,cinder:INSERT=27,cinder:UPDATE=95,cinder:DELETE=9 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:24:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7893332d-4ca4-4362-8807-e24f2ea40c04 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:47 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7893332d-4ca4-4362-8807-e24f2ea40c04 Jul 09 14:24:47 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:48 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7893332d-4ca4-4362-8807-e24f2ea40c04" returned: 0 in 0.731s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:24:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.956s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1613042015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f556b7-9f42-4658-9497-e514ed2db681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec2ea5a09df4bf898b8bbf995deaa61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:44Z,use_quota=True,user_id='2429387f875e400fbd1b4725479cc952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:24:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Creating volume 71f556b7-9f42-4658-9497-e514ed2db681 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:24:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:24:48 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:24:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-71f556b7-9f42-4658-9497-e514ed2db681 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2984a03-f315-4d88-9bb4-d8fc76c4df3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7893332d-4ca4-4362-8807-e24f2ea40c04', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:48 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-71f556b7-9f42-4658-9497-e514ed2db681 1073741824 Jul 09 14:24:48 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e787a3-0923-4029-9fdf-e63bd05c5227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:48 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Volume volume-7893332d-4ca4-4362-8807-e24f2ea40c04 (7893332d-4ca4-4362-8807-e24f2ea40c04): created successfully Jul 09 14:24:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e787a3-0923-4029-9fdf-e63bd05c5227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Flow 'volume_create_manager' (e87401f2-8ce3-4555-8c9f-defa859eef66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:48 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-de8f0b27-b52d-4ff6-ac00-47dd97b7fcea tempest-CreateVolumesFromSnapshotTest-1791390908 None] Created volume successfully. Jul 09 14:24:49 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-71f556b7-9f42-4658-9497-e514ed2db681 1073741824" returned: 0 in 0.886s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-71f556b7-9f42-4658-9497-e514ed2db681 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:49 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-71f556b7-9f42-4658-9497-e514ed2db681 Jul 09 14:24:49 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:50 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-71f556b7-9f42-4658-9497-e514ed2db681" returned: 0 in 0.711s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:24:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.128s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1741028000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a000eee-9945-406c-ae7a-3694938f438a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec2ea5a09df4bf898b8bbf995deaa61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:24:45Z,use_quota=True,user_id='2429387f875e400fbd1b4725479cc952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:24:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Creating volume 1a000eee-9945-406c-ae7a-3694938f438a {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:24:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:24:50 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:24:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1a000eee-9945-406c-ae7a-3694938f438a 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:50 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1a000eee-9945-406c-ae7a-3694938f438a 1073741824 Jul 09 14:24:50 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe597a7f-69e9-40bb-a610-2a8cf78cb0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71f556b7-9f42-4658-9497-e514ed2db681', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee1e5bc-78d1-4a57-8182-b3f8623b3063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:50 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Volume volume-71f556b7-9f42-4658-9497-e514ed2db681 (71f556b7-9f42-4658-9497-e514ed2db681): created successfully Jul 09 14:24:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee1e5bc-78d1-4a57-8182-b3f8623b3063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Flow 'volume_create_manager' (12b9875f-63af-4906-b8da-1a5bf3655feb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:50 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-5a0ade9f-24ee-4465-9150-bd3fc2481e99 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Created volume successfully. Jul 09 14:24:51 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1a000eee-9945-406c-ae7a-3694938f438a 1073741824" returned: 0 in 0.936s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1a000eee-9945-406c-ae7a-3694938f438a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:51 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1a000eee-9945-406c-ae7a-3694938f438a Jul 09 14:24:51 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:51 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1a000eee-9945-406c-ae7a-3694938f438a" returned: 0 in 0.680s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:24:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da8cd370-cbf3-4706-85a9-4f2c5de4e592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a000eee-9945-406c-ae7a-3694938f438a', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8031f90-8b24-46ad-ae70-44316d92bf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:24:51 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Volume volume-1a000eee-9945-406c-ae7a-3694938f438a (1a000eee-9945-406c-ae7a-3694938f438a): created successfully Jul 09 14:24:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8031f90-8b24-46ad-ae70-44316d92bf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:24:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Flow 'volume_create_manager' (00f39d75-72c2-4239-b4d9-9a7696074d6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:24:51 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-922dc5cc-a555-4d2c-9ffc-87e5fdb1098f tempest-CreateVolumesFromSnapshotTest-1791390908 None] Created volume successfully. Jul 09 14:24:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "cinder-1a000eee-9945-406c-ae7a-3694938f438a-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-1a000eee-9945-406c-ae7a-3694938f438a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "cinder-quobyte-1a000eee-9945-406c-ae7a-3694938f438a" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-quobyte-1a000eee-9945-406c-ae7a-3694938f438a" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:52 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b494f2-0a71-4e60-9203-a8287eaccea1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:24:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1a000eee-9945-406c-ae7a-3694938f438a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:52 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1a000eee-9945-406c-ae7a-3694938f438a Jul 09 14:24:52 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:53 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1a000eee-9945-406c-ae7a-3694938f438a" returned: 0 in 0.790s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1a000eee-9945-406c-ae7a-3694938f438a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:53 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1a000eee-9945-406c-ae7a-3694938f438a Jul 09 14:24:53 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:54 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-1a000eee-9945-406c-ae7a-3694938f438a" returned: 0 in 0.697s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-quobyte-1a000eee-9945-406c-ae7a-3694938f438a" released by "delete_volume" :: held 1.534s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:54 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] Created reservations ['7839ddf7-9efa-4c20-9954-64fb40a15934', '72bcda5d-d385-4165-ba64-10f84e30a53a', 'f5f8350a-17d8-4ca5-80fb-191be1a9c26b', 'd3b38e3e-7fd3-4987-a304-6afb4aaa0024'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:24:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:54 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:24:54 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "cinder-71f556b7-9f42-4658-9497-e514ed2db681-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-71f556b7-9f42-4658-9497-e514ed2db681-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "cinder-quobyte-71f556b7-9f42-4658-9497-e514ed2db681" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-quobyte-71f556b7-9f42-4658-9497-e514ed2db681" acquired by "delete_volume" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:55 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32c5786-a8c2-4894-b1ff-6f46478099c0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:24:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-71f556b7-9f42-4658-9497-e514ed2db681 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:55 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.760s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:55 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:24:55 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] Deleted volume successfully. Jul 09 14:24:55 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-71f556b7-9f42-4658-9497-e514ed2db681 Jul 09 14:24:55 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b79137dc-8977-41e9-9c2c-457c1cd5743e tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-1a000eee-9945-406c-ae7a-3694938f438a-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:55 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-71f556b7-9f42-4658-9497-e514ed2db681" returned: 0 in 0.788s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-71f556b7-9f42-4658-9497-e514ed2db681 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:55 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-71f556b7-9f42-4658-9497-e514ed2db681 Jul 09 14:24:55 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:56 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-71f556b7-9f42-4658-9497-e514ed2db681" returned: 0 in 0.665s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-quobyte-71f556b7-9f42-4658-9497-e514ed2db681" released by "delete_volume" :: held 1.504s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:56 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Created reservations ['f99b1f7d-ff3e-4331-b9bb-ac45f2df75b1', '45778ed3-dc12-4fbc-bb88-bf4171e0025b', '1e3c997f-99c2-4e87-9af5-af8787261820', '3dbedac7-d6a5-4943-b209-32427cb884c6'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:24:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:56 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:24:56 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "cinder-7893332d-4ca4-4362-8807-e24f2ea40c04-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-7893332d-4ca4-4362-8807-e24f2ea40c04-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "cinder-quobyte-7893332d-4ca4-4362-8807-e24f2ea40c04" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-quobyte-7893332d-4ca4-4362-8807-e24f2ea40c04" acquired by "delete_volume" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:57 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b935188-257f-4aac-883e-0610009d6c19]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:24:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7893332d-4ca4-4362-8807-e24f2ea40c04 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:57 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.699s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:57 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:24:57 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Deleted volume successfully. Jul 09 14:24:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-be2557eb-3f18-4f0b-8d31-49b2777b8acc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-71f556b7-9f42-4658-9497-e514ed2db681-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:57 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7893332d-4ca4-4362-8807-e24f2ea40c04 Jul 09 14:24:57 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:58 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7893332d-4ca4-4362-8807-e24f2ea40c04" returned: 0 in 0.758s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7893332d-4ca4-4362-8807-e24f2ea40c04 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:58 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7893332d-4ca4-4362-8807-e24f2ea40c04 Jul 09 14:24:58 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:58 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7893332d-4ca4-4362-8807-e24f2ea40c04" returned: 0 in 0.682s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-quobyte-7893332d-4ca4-4362-8807-e24f2ea40c04" released by "delete_volume" :: held 1.494s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:58 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] Created reservations ['fa0f7845-fb2c-4c6b-b276-e7fc3acd3c2a', '30f0cda7-346e-4ec6-b9c1-3be8e1f90612', '80812809-6c49-4f40-9483-5e806e473612', 'bfd73d07-6719-46a0-9e2c-e12d5551002e'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:24:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:24:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:24:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:24:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:24:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:24:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:58 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:24:58 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:24:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "cinder-c7689d1d-5a35-4313-a70d-263b707a0f83-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-c7689d1d-5a35-4313-a70d-263b707a0f83-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "cinder-quobyte-c7689d1d-5a35-4313-a70d-263b707a0f83" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:24:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-quobyte-c7689d1d-5a35-4313-a70d-263b707a0f83" acquired by "delete_volume" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:24:59 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94a0dd6-1cdc-4547-8684-aeb5c9f8ebdb]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:24:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c7689d1d-5a35-4313-a70d-263b707a0f83 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:24:59 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Jul 09 14:24:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.669s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:24:59 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:24:59 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] Deleted volume successfully. Jul 09 14:24:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d7c747fd-8490-4d71-bf2b-c9a36889f33d tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-7893332d-4ca4-4362-8807-e24f2ea40c04-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:24:59 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c7689d1d-5a35-4313-a70d-263b707a0f83 Jul 09 14:24:59 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:00 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c7689d1d-5a35-4313-a70d-263b707a0f83" returned: 0 in 0.801s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c7689d1d-5a35-4313-a70d-263b707a0f83 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:00 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c7689d1d-5a35-4313-a70d-263b707a0f83 Jul 09 14:25:00 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:00 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c7689d1d-5a35-4313-a70d-263b707a0f83" returned: 0 in 0.622s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:00 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-quobyte-c7689d1d-5a35-4313-a70d-263b707a0f83" released by "delete_volume" :: held 1.461s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:25:01 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Created reservations ['f4b0217a-4f36-4832-9c9b-f2142fdc7c65', '735b0eb2-b2a1-4ed8-8d7b-be059388923f', '4aa4c676-dace-44d7-a841-1f7a02acdd78', '90a5aa48-5d52-436d-a135-1212ba07509c'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:25:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:01 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:25:01 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:25:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:01 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:25:01 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "cinder-d26249eb-4597-4603-ba36-d593e169a2b5-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:25:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-d26249eb-4597-4603-ba36-d593e169a2b5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:25:01 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "cinder-quobyte-d26249eb-4597-4603-ba36-d593e169a2b5" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:25:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.635s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:01 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:25:01 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Deleted volume successfully. Jul 09 14:25:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-quobyte-d26249eb-4597-4603-ba36-d593e169a2b5" acquired by "delete_volume" :: waited 0.028s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:25:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-82bba5f4-2d53-4815-a21b-2f7216809bdc tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-c7689d1d-5a35-4313-a70d-263b707a0f83-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:25:01 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f999cb-791f-494e-9011-cebc472177cd]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:25:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d26249eb-4597-4603-ba36-d593e169a2b5 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:01 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d26249eb-4597-4603-ba36-d593e169a2b5 Jul 09 14:25:01 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:02 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d26249eb-4597-4603-ba36-d593e169a2b5" returned: 0 in 0.751s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d26249eb-4597-4603-ba36-d593e169a2b5 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:02 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d26249eb-4597-4603-ba36-d593e169a2b5 Jul 09 14:25:02 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:03 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d26249eb-4597-4603-ba36-d593e169a2b5" returned: 0 in 0.641s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-quobyte-d26249eb-4597-4603-ba36-d593e169a2b5" released by "delete_volume" :: held 1.435s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Created reservations ['18c36fe5-c3fe-4baa-a5b5-118b53095c43', 'f248eafe-5e2c-4550-bc1a-5f4da0b04c47', '0d96e758-1506-468e-978c-6261c6dbb641', '9c05184f-97a3-4d77-9739-eba54bebc11a'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:03 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:25:03 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "cinder-6464415c-1b85-4299-a048-f301ea3afa11-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-6464415c-1b85-4299-a048-f301ea3afa11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "cinder-quobyte-be50f12a-e0af-4c3d-a927-dca84e337d8e" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-quobyte-be50f12a-e0af-4c3d-a927-dca84e337d8e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "cinder-quobyte-6464415c-1b85-4299-a048-f301ea3afa11" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-quobyte-6464415c-1b85-4299-a048-f301ea3afa11" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] Deleting offline snapshot 6464415c-1b85-4299-a048-f301ea3afa11 of volume be50f12a-e0af-4c3d-a927-dca84e337d8e {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:25:03 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] snapshot_file for this snap is: volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.676s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:25:03 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Deleted volume successfully. Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff597a89-c9fc-4c55-b1a1-96fe2f89856f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:25:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6eb73637-74e4-4c96-8eeb-47c8a011ecd9 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-d26249eb-4597-4603-ba36-d593e169a2b5-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:25:04 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11 Jul 09 14:25:04 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:04 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11" returned: 0 in 0.758s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be50f12a-e0af-4c3d-a927-dca84e337d8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:25:04 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf09c347-c587-4894-9f32-f5683b0b0c27]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:25:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:04 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e Jul 09 14:25:04 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:05 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e" returned: 0 in 0.890s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:05 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11 Jul 09 14:25:05 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:06 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11" returned: 0 in 0.851s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:06 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11 Jul 09 14:25:06 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:07 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e.6464415c-1b85-4299-a048-f301ea3afa11" returned: 0 in 0.702s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-quobyte-6464415c-1b85-4299-a048-f301ea3afa11" released by "_delete_snapshot" :: held 3.324s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:25:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-quobyte-be50f12a-e0af-4c3d-a927-dca84e337d8e" released by "delete_snapshot" :: held 3.345s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:25:07 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] Created reservations ['b6607af7-fe18-4905-84c2-632ee8e70d40', 'ebb14dfc-b67e-4b06-a127-1136022cd76f', 'c4ec7c7f-f9fe-4a65-9162-10c9e696d350', '3707e0a2-4700-4a17-a0d8-48877e170af0'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:25:07 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] Delete snapshot completed successfully. Jul 09 14:25:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-8957f575-47c6-46e9-b546-6fd6a16b78aa tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-6464415c-1b85-4299-a048-f301ea3afa11-delete_snapshot" released by "delete_snapshot" :: held 3.488s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:25:08 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "cinder-be50f12a-e0af-4c3d-a927-dca84e337d8e-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:25:08 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-be50f12a-e0af-4c3d-a927-dca84e337d8e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:25:08 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "cinder-quobyte-be50f12a-e0af-4c3d-a927-dca84e337d8e" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:25:08 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-quobyte-be50f12a-e0af-4c3d-a927-dca84e337d8e" acquired by "delete_volume" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:25:08 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d686f0-702d-44d4-b7a6-16d149bf3aad]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:25:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:08 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e Jul 09 14:25:08 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:08 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e" returned: 0 in 0.755s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:08 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e Jul 09 14:25:08 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:09 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-be50f12a-e0af-4c3d-a927-dca84e337d8e" returned: 0 in 0.613s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-quobyte-be50f12a-e0af-4c3d-a927-dca84e337d8e" released by "delete_volume" :: held 1.420s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:25:09 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Created reservations ['e638c403-2209-47b6-99db-08c38dc87baa', '1c2120ae-11e5-428f-b667-81b3d0b04f2c', '238b7eff-9f73-40a4-a795-e216cfc54c40', '691e2da3-7eeb-4664-86f4-0f7f0d4290d2'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:25:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:25:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:25:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:09 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:25:09 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:10 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.803s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:10 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:25:10 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Deleted volume successfully. Jul 09 14:25:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c4e2ce19-6b53-49e7-8ab5-4fb6486aa908 tempest-CreateVolumesFromSnapshotTest-1791390908 None] Lock "cinder-be50f12a-e0af-4c3d-a927-dca84e337d8e-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:25:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:25:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:25:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:25:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:12 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:25:12 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:13 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.730s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:25:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:25:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:25:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Flow 'volume_create_manager' (b36b0a0e-5ed1-481d-8940-21e8bd37ed6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1244dd69-1d82-4746-be13-6c15137d4bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1244dd69-1d82-4746-be13-6c15137d4bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072067208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60d52f9-05c7-485e-88be-9a80a30c1c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11c9e55b86b4c8aac3564efcfafc1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:25:14Z,use_quota=True,user_id='b225f21da7474c74b85fced6951f4875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27519fe6-6acb-45b1-a542-9451d658b0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27519fe6-6acb-45b1-a542-9451d658b0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec9dcd7-8c81-4a2c-8655-d42284321932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec9dcd7-8c81-4a2c-8655-d42284321932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd60d52f9-05c7-485e-88be-9a80a30c1c52', 'volume_name': 'volume-d60d52f9-05c7-485e-88be-9a80a30c1c52', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1c5a3b-aab4-4345-8c0c-707892a23481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1c5a3b-aab4-4345-8c0c-707892a23481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9afecd02-97b7-408e-b77c-5ba0762f2756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:14 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Volume d60d52f9-05c7-485e-88be-9a80a30c1c52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d60d52f9-05c7-485e-88be-9a80a30c1c52', 'volume_size': 1} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072067208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d60d52f9-05c7-485e-88be-9a80a30c1c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11c9e55b86b4c8aac3564efcfafc1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:25:14Z,use_quota=True,user_id='b225f21da7474c74b85fced6951f4875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Creating volume d60d52f9-05c7-485e-88be-9a80a30c1c52 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:25:14 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:25:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d60d52f9-05c7-485e-88be-9a80a30c1c52 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:14 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d60d52f9-05c7-485e-88be-9a80a30c1c52 1073741824 Jul 09 14:25:14 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:15 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d60d52f9-05c7-485e-88be-9a80a30c1c52 1073741824" returned: 0 in 1.020s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d60d52f9-05c7-485e-88be-9a80a30c1c52 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:15 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d60d52f9-05c7-485e-88be-9a80a30c1c52 Jul 09 14:25:15 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:16 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d60d52f9-05c7-485e-88be-9a80a30c1c52" returned: 0 in 0.714s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:25:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9afecd02-97b7-408e-b77c-5ba0762f2756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d60d52f9-05c7-485e-88be-9a80a30c1c52', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d925208-0488-4e23-80c3-6f0c6a3a6814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:16 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Volume volume-d60d52f9-05c7-485e-88be-9a80a30c1c52 (d60d52f9-05c7-485e-88be-9a80a30c1c52): created successfully Jul 09 14:25:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d925208-0488-4e23-80c3-6f0c6a3a6814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Flow 'volume_create_manager' (b36b0a0e-5ed1-481d-8940-21e8bd37ed6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:25:16 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-f1f78052-b4ef-44cb-a280-b89458daf207 tempest-ProjectReaderTests-1438971236 None] Created volume successfully. Jul 09 14:25:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] Acquiring lock "cinder-d60d52f9-05c7-485e-88be-9a80a30c1c52-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:25:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] Lock "cinder-d60d52f9-05c7-485e-88be-9a80a30c1c52-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:25:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] Acquiring lock "cinder-quobyte-d60d52f9-05c7-485e-88be-9a80a30c1c52" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:25:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] Lock "cinder-quobyte-d60d52f9-05c7-485e-88be-9a80a30c1c52" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:25:16 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[344dfd2f-e380-4d46-9cc9-85f88bdd8470]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:25:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d60d52f9-05c7-485e-88be-9a80a30c1c52 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:16 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d60d52f9-05c7-485e-88be-9a80a30c1c52 Jul 09 14:25:16 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:17 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d60d52f9-05c7-485e-88be-9a80a30c1c52" returned: 0 in 0.854s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d60d52f9-05c7-485e-88be-9a80a30c1c52 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:17 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d60d52f9-05c7-485e-88be-9a80a30c1c52 Jul 09 14:25:17 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:18 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d60d52f9-05c7-485e-88be-9a80a30c1c52" returned: 0 in 0.715s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] Lock "cinder-quobyte-d60d52f9-05c7-485e-88be-9a80a30c1c52" released by "delete_volume" :: held 1.609s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:25:18 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] Created reservations ['19b6385f-acd3-42e5-9131-9857b78fe604', '7b3f1d7f-0bbc-44a7-b383-52674d81343b', '1d158825-de79-4fee-9071-c9bb780bc3bd', '30a9fc1e-6ec2-4ddf-b013-e5ca4184a6b8'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:25:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:25:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:25:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:18 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:25:18 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:19 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.739s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:25:19 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] Deleted volume successfully. Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cde9a984-7096-49a7-b137-98b1c2f247fe tempest-ProjectReaderTests-1438971236 None] Lock "cinder-d60d52f9-05c7-485e-88be-9a80a30c1c52-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Flow 'volume_create_manager' (916ae5f2-f306-498d-aa40-4dea8dee6222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5460cb-09a3-4593-8fd0-72aa506b1977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5460cb-09a3-4593-8fd0-72aa506b1977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-617953687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d503f2e7-47ca-4169-b2b3-7e9a95df1f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11c9e55b86b4c8aac3564efcfafc1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:25:19Z,use_quota=True,user_id='b225f21da7474c74b85fced6951f4875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c320b570-4265-4d8e-a5bc-7fe21e86121b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c320b570-4265-4d8e-a5bc-7fe21e86121b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f563adf-a5a3-48dd-aed8-6e243651437d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f563adf-a5a3-48dd-aed8-6e243651437d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd503f2e7-47ca-4169-b2b3-7e9a95df1f0a', 'volume_name': 'volume-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6845b8-190a-4ed2-9dff-ff189c2efbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6845b8-190a-4ed2-9dff-ff189c2efbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3d5233-9c6c-4835-b628-e28797d706d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:19 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Volume d503f2e7-47ca-4169-b2b3-7e9a95df1f0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a', 'volume_size': 1} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-617953687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d503f2e7-47ca-4169-b2b3-7e9a95df1f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11c9e55b86b4c8aac3564efcfafc1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:25:19Z,use_quota=True,user_id='b225f21da7474c74b85fced6951f4875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Creating volume d503f2e7-47ca-4169-b2b3-7e9a95df1f0a {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:25:19 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:25:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:19 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a 1073741824 Jul 09 14:25:19 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:20 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a 1073741824" returned: 0 in 0.875s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:20 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a Jul 09 14:25:20 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:21 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a" returned: 0 in 0.727s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:25:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3d5233-9c6c-4835-b628-e28797d706d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4869c099-8c03-45c6-83ad-c793c37fe666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:21 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Volume volume-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a (d503f2e7-47ca-4169-b2b3-7e9a95df1f0a): created successfully Jul 09 14:25:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4869c099-8c03-45c6-83ad-c793c37fe666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Flow 'volume_create_manager' (916ae5f2-f306-498d-aa40-4dea8dee6222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:25:21 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-e03e41a6-35f0-434d-9955-14635860c3f9 tempest-ProjectReaderTests-1438971236 None] Created volume successfully. Jul 09 14:25:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] Acquiring lock "cinder-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:25:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] Lock "cinder-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:25:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] Acquiring lock "cinder-quobyte-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:25:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] Lock "cinder-quobyte-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a" acquired by "delete_volume" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:25:21 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4826a46-7145-467d-8d39-cf9d5c87364a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:25:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:21 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a Jul 09 14:25:21 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:22 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a" returned: 0 in 0.784s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:22 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a Jul 09 14:25:22 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:23 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a" returned: 0 in 0.692s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:23 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] Lock "cinder-quobyte-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a" released by "delete_volume" :: held 1.534s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:25:23 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] Created reservations ['d3dcb014-8773-445f-bb2e-c94ef75e49f8', '0e8697b3-fcb5-4203-ad5f-87ce138cf09a', '81211656-ea4c-465e-9c29-eea076ef6e26', 'c37c6d8a-4933-4d45-9c79-1efc81bf0c23'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:25:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:25:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:25:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:23 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:25:23 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:23 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.671s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:23 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:25:23 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] Deleted volume successfully. Jul 09 14:25:23 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e21d205f-122f-4195-8477-b348e988e460 tempest-ProjectReaderTests-1438971236 None] Lock "cinder-d503f2e7-47ca-4169-b2b3-7e9a95df1f0a-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:25:33 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=57,cinder:UPDATE=88,cinder:INSERT=21,cinder:DELETE=6 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:25:33 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=79,cinder:SELECT=49,cinder:DELETE=7,cinder:INSERT=19 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Flow 'volume_create_manager' (272c2648-27bc-4b24-bdf4-32e515ded265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d406e027-f8b1-4cd4-964a-edc0c750031b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d406e027-f8b1-4cd4-964a-edc0c750031b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-650257101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4555dd-081b-4c45-9da8-002efc2ccecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c35a2e9afb744e08148ed6cc0ef3713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:25:37Z,use_quota=True,user_id='245b031db0b742538f9ed374de907b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ca6e15-6b59-4763-b8ed-ce5889cc8591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ca6e15-6b59-4763-b8ed-ce5889cc8591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1a48a1-c631-4861-9914-23f878698f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1a48a1-c631-4861-9914-23f878698f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c4555dd-081b-4c45-9da8-002efc2ccecf', 'volume_name': 'volume-3c4555dd-081b-4c45-9da8-002efc2ccecf', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf11bfb8-c2fc-488c-85c9-e6a0e4482011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf11bfb8-c2fc-488c-85c9-e6a0e4482011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a951d7aa-f7b8-4b57-b7e1-814030e82e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:37 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Volume 3c4555dd-081b-4c45-9da8-002efc2ccecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c4555dd-081b-4c45-9da8-002efc2ccecf', 'volume_size': 1} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-650257101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c4555dd-081b-4c45-9da8-002efc2ccecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c35a2e9afb744e08148ed6cc0ef3713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:25:37Z,use_quota=True,user_id='245b031db0b742538f9ed374de907b13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Creating volume 3c4555dd-081b-4c45-9da8-002efc2ccecf {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:25:37 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:25:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c4555dd-081b-4c45-9da8-002efc2ccecf 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:37 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c4555dd-081b-4c45-9da8-002efc2ccecf 1073741824 Jul 09 14:25:37 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:38 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c4555dd-081b-4c45-9da8-002efc2ccecf 1073741824" returned: 0 in 0.904s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c4555dd-081b-4c45-9da8-002efc2ccecf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:38 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c4555dd-081b-4c45-9da8-002efc2ccecf Jul 09 14:25:38 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:38 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c4555dd-081b-4c45-9da8-002efc2ccecf" returned: 0 in 0.675s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:25:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a951d7aa-f7b8-4b57-b7e1-814030e82e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c4555dd-081b-4c45-9da8-002efc2ccecf', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3da8b0-0d99-4daa-a853-d11e23982b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:38 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Volume volume-3c4555dd-081b-4c45-9da8-002efc2ccecf (3c4555dd-081b-4c45-9da8-002efc2ccecf): created successfully Jul 09 14:25:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3da8b0-0d99-4daa-a853-d11e23982b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Flow 'volume_create_manager' (272c2648-27bc-4b24-bdf4-32e515ded265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:25:38 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-62e75963-bae3-4fd4-b2d4-0576d22eca0c tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Created volume successfully. Jul 09 14:25:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-1cdf1cf1-61c0-4b4c-a95d-974fa83d8262 req-4ba88728-1a5a-4ce8-95cb-78b61a22d0b0 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-1cdf1cf1-61c0-4b4c-a95d-974fa83d8262 req-4ba88728-1a5a-4ce8-95cb-78b61a22d0b0 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:42 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8a82d0-2a4f-437d-999e-571ce486ab05]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:25:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-1cdf1cf1-61c0-4b4c-a95d-974fa83d8262 req-4ba88728-1a5a-4ce8-95cb-78b61a22d0b0 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c4555dd-081b-4c45-9da8-002efc2ccecf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:42 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c4555dd-081b-4c45-9da8-002efc2ccecf Jul 09 14:25:42 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:43 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-1cdf1cf1-61c0-4b4c-a95d-974fa83d8262 req-4ba88728-1a5a-4ce8-95cb-78b61a22d0b0 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c4555dd-081b-4c45-9da8-002efc2ccecf" returned: 0 in 0.850s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-1cdf1cf1-61c0-4b4c-a95d-974fa83d8262 req-4ba88728-1a5a-4ce8-95cb-78b61a22d0b0 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.869s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-1cdf1cf1-61c0-4b4c-a95d-974fa83d8262 req-4ba88728-1a5a-4ce8-95cb-78b61a22d0b0 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-3c4555dd-081b-4c45-9da8-002efc2ccecf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84f03a2a-4c2f-4f5e-84e1-6f217a4c5759', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:25:43 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-1cdf1cf1-61c0-4b4c-a95d-974fa83d8262 req-4ba88728-1a5a-4ce8-95cb-78b61a22d0b0 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] attachment_update completed successfully. Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Flow 'volume_create_manager' (f5509b1d-d3f5-4498-815d-60d44a421b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7eedcc-0e61-4707-8a36-a399271318ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7eedcc-0e61-4707-8a36-a399271318ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-295461305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483db314-6101-43dd-9d8e-287a0c69258b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc24f76be804fca97e42456ef7e928f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:25:46Z,use_quota=True,user_id='8cfca33638ba4cf38a1161113d3e8a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dcd3f0b-4c55-4a2f-9212-534150b2218c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dcd3f0b-4c55-4a2f-9212-534150b2218c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b5ff5fe-fed5-4bf8-8915-4061cce95f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b5ff5fe-fed5-4bf8-8915-4061cce95f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '483db314-6101-43dd-9d8e-287a0c69258b', 'volume_name': 'volume-483db314-6101-43dd-9d8e-287a0c69258b', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37af1518-2524-4d6e-8fa8-8a8541ac3080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37af1518-2524-4d6e-8fa8-8a8541ac3080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5138c81-29ae-4fff-8646-05169a6acb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:46 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Volume 483db314-6101-43dd-9d8e-287a0c69258b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-483db314-6101-43dd-9d8e-287a0c69258b', 'volume_size': 1} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-295461305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483db314-6101-43dd-9d8e-287a0c69258b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc24f76be804fca97e42456ef7e928f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:25:46Z,use_quota=True,user_id='8cfca33638ba4cf38a1161113d3e8a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Creating volume 483db314-6101-43dd-9d8e-287a0c69258b {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:25:46 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:25:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:46 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b 1073741824 Jul 09 14:25:46 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:47 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b 1073741824" returned: 0 in 0.898s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:47 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b Jul 09 14:25:47 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:48 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b" returned: 0 in 0.665s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:25:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5138c81-29ae-4fff-8646-05169a6acb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-483db314-6101-43dd-9d8e-287a0c69258b', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13bfc55-1a1c-4fa9-9430-12d115b3d498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:48 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Volume volume-483db314-6101-43dd-9d8e-287a0c69258b (483db314-6101-43dd-9d8e-287a0c69258b): created successfully Jul 09 14:25:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13bfc55-1a1c-4fa9-9430-12d115b3d498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Flow 'volume_create_manager' (f5509b1d-d3f5-4498-815d-60d44a421b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:25:48 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9c3416cf-0dea-44e6-b5d6-663c71c6d0d1 tempest-SnapshotDependencyTests-1103539384 None] Created volume successfully. Jul 09 14:25:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] Creating offline snapshot a28ae053-fcb8-4b26-a117-6e5aefd236c8 of volume 483db314-6101-43dd-9d8e-287a0c69258b {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:25:48 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d28e7e7-7f5f-4871-8f61-7235db1bac2b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:25:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:48 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b Jul 09 14:25:48 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:49 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b" returned: 0 in 0.856s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:49 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8 1G Jul 09 14:25:49 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:49 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-1c11d879-3d88-496d-bc5a-5a7efa81ae73 req-cddfa141-e77c-471f-9cd7-ce1ce5ca33a5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Terminate volume connection completed successfully. Jul 09 14:25:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-1c11d879-3d88-496d-bc5a-5a7efa81ae73 req-cddfa141-e77c-471f-9cd7-ce1ce5ca33a5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Deleting attachment 84f03a2a-4c2f-4f5e-84e1-6f217a4c5759. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:25:50 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8 1G" returned: 0 in 0.869s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-483db314-6101-43dd-9d8e-287a0c69258b -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:50 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-483db314-6101-43dd-9d8e-287a0c69258b -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8 Jul 09 14:25:50 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:51 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-483db314-6101-43dd-9d8e-287a0c69258b -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8" returned: 0 in 0.740s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:51 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8 is being set with open permissions: ugo+rw Jul 09 14:25:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:51 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8 Jul 09 14:25:51 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Acquiring lock "cinder-3c4555dd-081b-4c45-9da8-002efc2ccecf-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:25:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Lock "cinder-3c4555dd-081b-4c45-9da8-002efc2ccecf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:25:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Acquiring lock "cinder-quobyte-3c4555dd-081b-4c45-9da8-002efc2ccecf" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:25:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Lock "cinder-quobyte-3c4555dd-081b-4c45-9da8-002efc2ccecf" acquired by "delete_volume" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:25:51 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6743910d-68f3-4f0a-9bda-6bb9503101c4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:25:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c4555dd-081b-4c45-9da8-002efc2ccecf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:52 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8" returned: 0 in 0.736s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:52 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c4555dd-081b-4c45-9da8-002efc2ccecf Jul 09 14:25:52 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:52 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.info Jul 09 14:25:52 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:52 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.info" returned: 0 in 0.651s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:52 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.info is being set with open permissions: ugo+rw Jul 09 14:25:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:52 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:52 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.info Jul 09 14:25:52 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c4555dd-081b-4c45-9da8-002efc2ccecf" returned: 0 in 0.772s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c4555dd-081b-4c45-9da8-002efc2ccecf {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:52 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c4555dd-081b-4c45-9da8-002efc2ccecf Jul 09 14:25:52 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:53 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.info" returned: 0 in 0.653s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.589s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:53 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c4555dd-081b-4c45-9da8-002efc2ccecf" returned: 0 in 0.659s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Lock "cinder-quobyte-3c4555dd-081b-4c45-9da8-002efc2ccecf" released by "delete_volume" :: held 1.471s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:25:53 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-fe1bd9b0-f2b2-49fe-b71a-543aaa186ae2 tempest-SnapshotDependencyTests-1103539384 None] Create snapshot completed successfully Jul 09 14:25:53 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Created reservations ['419126d5-8996-4b36-acdc-0ce9fc973e1d', '9b31d419-5d0c-4156-a5f0-a6a6656574f3', 'ef03ec72-e660-47ec-affb-e134fc0ec93d', 'c8712ac9-c40b-4820-82db-ce5ecb35a1ba'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:25:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:25:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:25:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:53 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:25:53 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:54 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.636s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:25:54 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Deleted volume successfully. Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b34aba94-e958-472c-827c-c209a2a834d5 tempest-TestServerVolumeAttachScenarioOldVersion-624820523 None] Lock "cinder-3c4555dd-081b-4c45-9da8-002efc2ccecf-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Flow 'volume_create_manager' (ecebc705-ee2a-4efd-970a-d2b53b6384e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1694254-2a92-4172-b613-7a2fd425da29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1694254-2a92-4172-b613-7a2fd425da29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc915c8-79b5-42e3-9708-b274ddd6d7f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc24f76be804fca97e42456ef7e928f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a28ae053-fcb8-4b26-a117-6e5aefd236c8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:25:55Z,use_quota=True,user_id='8cfca33638ba4cf38a1161113d3e8a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (729d2f7b-a8c3-4abc-bf3b-d8f3294549ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (729d2f7b-a8c3-4abc-bf3b-d8f3294549ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (152c522c-2550-4f33-bd93-668a0cd4af5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (152c522c-2550-4f33-bd93-668a0cd4af5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ebc915c8-79b5-42e3-9708-b274ddd6d7f2', 'volume_name': 'volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2', 'volume_size': 1, 'snapshot_id': 'a28ae053-fcb8-4b26-a117-6e5aefd236c8'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (808947c0-5c11-4bf3-9e06-61abf3ef7bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (808947c0-5c11-4bf3-9e06-61abf3ef7bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a84868-0bae-4d97-a7b4-d49ed379c72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:25:54 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Volume ebc915c8-79b5-42e3-9708-b274ddd6d7f2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2', 'volume_size': 1, 'snapshot_id': 'a28ae053-fcb8-4b26-a117-6e5aefd236c8'} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Acquiring lock "cinder-quobyte-a28ae053-fcb8-4b26-a117-6e5aefd236c8-ebc915c8-79b5-42e3-9708-b274ddd6d7f2" by "_create_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Lock "cinder-quobyte-a28ae053-fcb8-4b26-a117-6e5aefd236c8-ebc915c8-79b5-42e3-9708-b274ddd6d7f2" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Creating volume ebc915c8-79b5-42e3-9708-b274ddd6d7f2 from snapshot a28ae053-fcb8-4b26-a117-6e5aefd236c8 {{(pid=87011) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Acquiring lock "cinder-quobyte-ebc915c8-79b5-42e3-9708-b274ddd6d7f2" by "_copy_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Lock "cinder-quobyte-ebc915c8-79b5-42e3-9708-b274ddd6d7f2" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] snapshot: a28ae053-fcb8-4b26-a117-6e5aefd236c8, volume: ebc915c8-79b5-42e3-9708-b274ddd6d7f2, {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e815818-1ddd-4a6c-b41a-ae3a71091743]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:25:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:54 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8 Jul 09 14:25:54 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:55 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8" returned: 0 in 0.898s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-483db314-6101-43dd-9d8e-287a0c69258b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:25:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 14:25:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Creating direct copy from snapshot {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 14:25:55 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f7525d-a022-4300-b2cc-4173a3c192ce]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:25:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:55 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b Jul 09 14:25:55 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:25:56 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Jul 09 14:25:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b" returned: 0 in 0.881s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:25:56 devstack cinder-volume[87011]: DEBUG cinder.utils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Path /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2 not found in is_blk_device check {{(pid=87011) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 14:25:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:25:56 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2 Jul 09 14:25:56 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:26:01 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Jul 09 14:26:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2" returned: 0 in 4.908s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:26:01 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c912d7-8b95-49e3-9027-bc83082769c4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:26:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:26:01 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b Jul 09 14:26:01 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:26:02 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Jul 09 14:26:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b" returned: 0 in 1.014s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:26:02 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b, size 1024.00 MB, duration 4.91 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2 {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:26:02 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Converted 1024.00 MB image at 208.61 MB/s Jul 09 14:26:02 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2 is being set with open permissions: ugo+rw Jul 09 14:26:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:26:02 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2 Jul 09 14:26:02 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:26:03 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Jul 09 14:26:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2" returned: 0 in 0.688s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:26:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Lock "cinder-quobyte-ebc915c8-79b5-42e3-9708-b274ddd6d7f2" released by "_copy_volume_from_snapshot" :: held 8.479s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:26:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Lock "cinder-quobyte-a28ae053-fcb8-4b26-a117-6e5aefd236c8-ebc915c8-79b5-42e3-9708-b274ddd6d7f2" released by "_create_volume_from_snapshot" :: held 8.510s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:26:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.529s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:26:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a84868-0bae-4d97-a7b4-d49ed379c72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2', 'volume_size': 1, 'snapshot_id': 'a28ae053-fcb8-4b26-a117-6e5aefd236c8'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:26:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35da39e-f362-4e96-91b3-b63619eb3bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:26:03 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Volume volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2 (ebc915c8-79b5-42e3-9708-b274ddd6d7f2): created successfully Jul 09 14:26:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35da39e-f362-4e96-91b3-b63619eb3bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:26:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Flow 'volume_create_manager' (ecebc705-ee2a-4efd-970a-d2b53b6384e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:26:03 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d384285a-fb99-4429-8cfe-eb9c644da13e tempest-SnapshotDependencyTests-1103539384 None] Created volume successfully. Jul 09 14:26:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] Acquiring lock "cinder-a28ae053-fcb8-4b26-a117-6e5aefd236c8-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:26:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] Lock "cinder-a28ae053-fcb8-4b26-a117-6e5aefd236c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:26:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] Acquiring lock "cinder-quobyte-483db314-6101-43dd-9d8e-287a0c69258b" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:26:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] Lock "cinder-quobyte-483db314-6101-43dd-9d8e-287a0c69258b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:26:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] Acquiring lock "cinder-quobyte-a28ae053-fcb8-4b26-a117-6e5aefd236c8" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:26:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] Lock "cinder-quobyte-a28ae053-fcb8-4b26-a117-6e5aefd236c8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:26:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] Deleting offline snapshot a28ae053-fcb8-4b26-a117-6e5aefd236c8 of volume 483db314-6101-43dd-9d8e-287a0c69258b {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:26:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] snapshot_file for this snap is: volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:26:03 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[3842dd69-a140-497a-a564-d7fa67968168]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:26:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:26:03 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8 Jul 09 14:26:03 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:26:04 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Jul 09 14:26:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8" returned: 0 in 0.789s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:26:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-483db314-6101-43dd-9d8e-287a0c69258b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:26:04 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec04c5ea-8cde-4c4b-8ca8-44ee53485e46]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:26:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:26:04 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b Jul 09 14:26:04 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:26:05 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Jul 09 14:26:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b" returned: 0 in 0.836s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:26:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:26:05 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8 Jul 09 14:26:05 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:26:06 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Jul 09 14:26:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8" returned: 0 in 0.894s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:26:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:26:06 devstack sudo[103634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8 Jul 09 14:26:06 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:26:06 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root Jul 09 14:26:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b.a28ae053-fcb8-4b26-a117-6e5aefd236c8" returned: 0 in 0.764s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:26:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] Lock "cinder-quobyte-a28ae053-fcb8-4b26-a117-6e5aefd236c8" released by "_delete_snapshot" :: held 3.428s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:26:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] Lock "cinder-quobyte-483db314-6101-43dd-9d8e-287a0c69258b" released by "delete_snapshot" :: held 3.458s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:26:07 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] Created reservations ['b5e07840-b766-428e-aacc-9ffcc20ec308', 'e8f905c5-36da-41ce-b335-c4a083d24639', 'ab0b1269-7c02-4259-9e38-b2c28d2db438', 'b2283318-4733-4be0-95ce-86b669b89097'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:26:07 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] Delete snapshot completed successfully. Jul 09 14:26:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d7370d65-ccc3-4384-af7f-3d49d8397a8e tempest-SnapshotDependencyTests-1103539384 None] Lock "cinder-a28ae053-fcb8-4b26-a117-6e5aefd236c8-delete_snapshot" released by "delete_snapshot" :: held 3.606s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:26:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] Acquiring lock "cinder-483db314-6101-43dd-9d8e-287a0c69258b-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:26:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] Lock "cinder-483db314-6101-43dd-9d8e-287a0c69258b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:26:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] Acquiring lock "cinder-quobyte-483db314-6101-43dd-9d8e-287a0c69258b" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:26:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] Lock "cinder-quobyte-483db314-6101-43dd-9d8e-287a0c69258b" acquired by "delete_volume" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:26:07 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4238e4b-f79a-4698-b01e-ce000d953b1d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:26:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:26:08 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b Jul 09 14:26:08 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:26:08 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Jul 09 14:26:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b" returned: 0 in 0.958s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:26:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:26:08 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b Jul 09 14:26:08 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:26:09 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Jul 09 14:26:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-483db314-6101-43dd-9d8e-287a0c69258b" returned: 0 in 0.703s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:26:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] Lock "cinder-quobyte-483db314-6101-43dd-9d8e-287a0c69258b" released by "delete_volume" :: held 1.744s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:26:09 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] Created reservations ['9790ac6e-a90b-43fb-ae78-851b5a3e2fc2', '8a0cab67-2067-48e9-af8f-6d1a71b942ea', 'a8e300de-967b-4966-b58e-626c1cddbfbf', '86dbf8e9-20b5-40b1-bdf3-d292ea107901'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:26:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:26:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:26:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:26:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:26:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:26:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:26:09 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:26:09 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:26:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] Acquiring lock "cinder-ebc915c8-79b5-42e3-9708-b274ddd6d7f2-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:26:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] Lock "cinder-ebc915c8-79b5-42e3-9708-b274ddd6d7f2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:26:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] Acquiring lock "cinder-quobyte-ebc915c8-79b5-42e3-9708-b274ddd6d7f2" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:26:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] Lock "cinder-quobyte-ebc915c8-79b5-42e3-9708-b274ddd6d7f2" acquired by "delete_volume" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:26:10 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9650d5-1dc0-4db1-9691-6bd15f130c49]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:26:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:26:10 devstack sudo[103686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2 Jul 09 14:26:10 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:26:10 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Jul 09 14:26:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.747s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:26:10 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:26:10 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] Deleted volume successfully. Jul 09 14:26:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-470cb7a2-ba8b-4453-a063-9e6869b5885d tempest-SnapshotDependencyTests-1103539384 None] Lock "cinder-483db314-6101-43dd-9d8e-287a0c69258b-delete_volume" released by "delete_volume" :: held 2.803s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:26:11 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root Jul 09 14:26:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2" returned: 0 in 0.801s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:26:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:26:11 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2 Jul 09 14:26:11 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:26:11 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Jul 09 14:26:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ebc915c8-79b5-42e3-9708-b274ddd6d7f2" returned: 0 in 0.673s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:26:11 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] Lock "cinder-quobyte-ebc915c8-79b5-42e3-9708-b274ddd6d7f2" released by "delete_volume" :: held 1.527s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:26:11 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] Created reservations ['cc89468a-d809-400d-beef-0b70c642c716', '0080f9b3-7a95-4053-81c8-b189215feeff', '32b2f6c0-7252-4534-a78a-46ac1b95a688', '10fbd8aa-82cf-409f-a92c-8a48e157cd1a'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:26:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:26:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:26:11 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:26:11 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:26:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:26:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:26:11 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:26:11 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:26:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:26:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:26:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:26:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:26:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:26:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:26:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:26:12 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:26:12 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:26:12 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Jul 09 14:26:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.701s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:26:12 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:26:12 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] Deleted volume successfully. Jul 09 14:26:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-37512c6b-f903-417b-8d97-8d1a1d6c085f tempest-SnapshotDependencyTests-1103539384 None] Lock "cinder-ebc915c8-79b5-42e3-9708-b274ddd6d7f2-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:26:13 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Jul 09 14:26:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.693s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:26:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:26:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:26:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:26:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:26:21 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=33,cinder:UPDATE=45,cinder:INSERT=11,cinder:DELETE=5 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:26:22 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=41,cinder:UPDATE=36,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Flow 'volume_create_manager' (c5be4317-f1f2-4982-997c-2c26bd9545eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e41034-f7a7-49d2-a4fd-7b60afa0db17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e41034-f7a7-49d2-a4fd-7b60afa0db17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1111072044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ecf37d0-164c-4c26-bd47-34b37642a4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2fbea303f8467483ca0573356d834c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:26:34Z,use_quota=True,user_id='e192de1d061848b89ea9677c8dc94be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0613a1-3654-4d62-bd33-30ab6a0a3a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0613a1-3654-4d62-bd33-30ab6a0a3a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3606ba-246f-4e1d-aff1-d293cb1f7379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3606ba-246f-4e1d-aff1-d293cb1f7379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ecf37d0-164c-4c26-bd47-34b37642a4fc', 'volume_name': 'volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a31bfbc-c9a1-44bd-a5c5-ae6f71f16e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a31bfbc-c9a1-44bd-a5c5-ae6f71f16e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305670ad-a880-46eb-8f4a-bef97e29712d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:26:34 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Volume 8ecf37d0-164c-4c26-bd47-34b37642a4fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc', 'volume_size': 1} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1111072044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ecf37d0-164c-4c26-bd47-34b37642a4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2fbea303f8467483ca0573356d834c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:26:34Z,use_quota=True,user_id='e192de1d061848b89ea9677c8dc94be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Creating volume 8ecf37d0-164c-4c26-bd47-34b37642a4fc {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:26:34 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:26:34 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc 1073741824 Jul 09 14:26:34 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Flow 'volume_create_manager' (7f900a75-5ba2-4a39-8928-347a2930b642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b9d232-3e78-4a94-b571-b8e0aaf21e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b9d232-3e78-4a94-b571-b8e0aaf21e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1626564816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23266542-be03-481b-8472-72714e06090e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2fbea303f8467483ca0573356d834c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:26:35Z,use_quota=True,user_id='e192de1d061848b89ea9677c8dc94be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f728ca-ebc5-4a58-9d02-77063cf37d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f728ca-ebc5-4a58-9d02-77063cf37d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b656c0a-b97f-4399-8bea-521c9de82a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b656c0a-b97f-4399-8bea-521c9de82a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23266542-be03-481b-8472-72714e06090e', 'volume_name': 'volume-23266542-be03-481b-8472-72714e06090e', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa6f573-c388-44c5-9286-16a8b65923ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa6f573-c388-44c5-9286-16a8b65923ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb05aaf-7a40-4eb3-968e-3c2e4da17099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:26:34 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Volume 23266542-be03-481b-8472-72714e06090e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23266542-be03-481b-8472-72714e06090e', 'volume_size': 1} Jul 09 14:26:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:26:35 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Jul 09 14:26:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc 1073741824" returned: 0 in 0.894s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:26:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:26:35 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc Jul 09 14:26:35 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:26:36 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc" returned: 0 in 0.699s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.275s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1626564816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23266542-be03-481b-8472-72714e06090e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2fbea303f8467483ca0573356d834c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:26:35Z,use_quota=True,user_id='e192de1d061848b89ea9677c8dc94be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Creating volume 23266542-be03-481b-8472-72714e06090e {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:26:36 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-23266542-be03-481b-8472-72714e06090e 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:26:36 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-23266542-be03-481b-8472-72714e06090e 1073741824 Jul 09 14:26:36 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305670ad-a880-46eb-8f4a-bef97e29712d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4feaf02f-035c-4d89-a9b4-42eb806de953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:26:36 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Volume volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc (8ecf37d0-164c-4c26-bd47-34b37642a4fc): created successfully Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4feaf02f-035c-4d89-a9b4-42eb806de953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Flow 'volume_create_manager' (c5be4317-f1f2-4982-997c-2c26bd9545eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:26:36 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-f97a51c3-b948-48f2-9079-786e1b7dbd65 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Created volume successfully. Jul 09 14:26:36 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-23266542-be03-481b-8472-72714e06090e 1073741824" returned: 0 in 0.874s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:26:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-23266542-be03-481b-8472-72714e06090e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:26:36 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-23266542-be03-481b-8472-72714e06090e Jul 09 14:26:36 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:26:37 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Jul 09 14:26:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-23266542-be03-481b-8472-72714e06090e" returned: 0 in 0.664s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:26:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:26:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:26:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb05aaf-7a40-4eb3-968e-3c2e4da17099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23266542-be03-481b-8472-72714e06090e', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:26:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562349cd-6a0b-457c-a8f4-8068750fc32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:26:37 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Volume volume-23266542-be03-481b-8472-72714e06090e (23266542-be03-481b-8472-72714e06090e): created successfully Jul 09 14:26:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562349cd-6a0b-457c-a8f4-8068750fc32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:26:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Flow 'volume_create_manager' (7f900a75-5ba2-4a39-8928-347a2930b642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:26:37 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-e1bcdad0-cfaa-4f78-b1bb-896791636bde tempest-TestServerVolumeAttachmentScenario-1784244126 None] Created volume successfully. Jul 09 14:26:47 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5,cinder:INSERT=2 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:26:47 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=4,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:26:58 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=1 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:26:58 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=1 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:27:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:27:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:27:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:27:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:27:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:27:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:27:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:27:12 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:27:12 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:27:13 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Jul 09 14:27:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.659s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:27:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:27:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:27:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:27:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:27:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-20971f0e-4464-4001-bf52-d1cc163ba971 req-6a7ab9f4-002d-4866-b173-1b239165702e tempest-TestServerVolumeAttachmentScenario-1784244126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:27:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-20971f0e-4464-4001-bf52-d1cc163ba971 req-6a7ab9f4-002d-4866-b173-1b239165702e tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:27:15 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ac5d31-2edc-4194-99b7-0c005d09e517]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:27:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-20971f0e-4464-4001-bf52-d1cc163ba971 req-6a7ab9f4-002d-4866-b173-1b239165702e tempest-TestServerVolumeAttachmentScenario-1784244126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:27:15 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc Jul 09 14:27:15 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:27:16 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Jul 09 14:27:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-20971f0e-4464-4001-bf52-d1cc163ba971 req-6a7ab9f4-002d-4866-b173-1b239165702e tempest-TestServerVolumeAttachmentScenario-1784244126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc" returned: 0 in 0.747s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:27:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-20971f0e-4464-4001-bf52-d1cc163ba971 req-6a7ab9f4-002d-4866-b173-1b239165702e tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.763s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:27:16 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-20971f0e-4464-4001-bf52-d1cc163ba971 req-6a7ab9f4-002d-4866-b173-1b239165702e tempest-TestServerVolumeAttachmentScenario-1784244126 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b0d81ce-6d41-44c5-a181-2b71690c8e62', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:27:16 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-20971f0e-4464-4001-bf52-d1cc163ba971 req-6a7ab9f4-002d-4866-b173-1b239165702e tempest-TestServerVolumeAttachmentScenario-1784244126 None] attachment_update completed successfully. Jul 09 14:27:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-8c6c1b24-e8dd-4a58-a8fa-275cd5e05b5b req-b4337d26-001e-4efe-a7e9-47f38ef3f134 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:27:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-8c6c1b24-e8dd-4a58-a8fa-275cd5e05b5b req-b4337d26-001e-4efe-a7e9-47f38ef3f134 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:27:25 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[4873ce46-6e5f-4b86-811a-772413c4eff8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:27:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-8c6c1b24-e8dd-4a58-a8fa-275cd5e05b5b req-b4337d26-001e-4efe-a7e9-47f38ef3f134 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-23266542-be03-481b-8472-72714e06090e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:27:25 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-23266542-be03-481b-8472-72714e06090e Jul 09 14:27:25 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:27:26 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jul 09 14:27:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-8c6c1b24-e8dd-4a58-a8fa-275cd5e05b5b req-b4337d26-001e-4efe-a7e9-47f38ef3f134 tempest-TestServerVolumeAttachmentScenario-1784244126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-23266542-be03-481b-8472-72714e06090e" returned: 0 in 0.768s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:27:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-8c6c1b24-e8dd-4a58-a8fa-275cd5e05b5b req-b4337d26-001e-4efe-a7e9-47f38ef3f134 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.786s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:27:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-8c6c1b24-e8dd-4a58-a8fa-275cd5e05b5b req-b4337d26-001e-4efe-a7e9-47f38ef3f134 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-23266542-be03-481b-8472-72714e06090e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7c8ff9d-0c1f-420b-98b4-36dbae03392c', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:27:26 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-8c6c1b24-e8dd-4a58-a8fa-275cd5e05b5b req-b4337d26-001e-4efe-a7e9-47f38ef3f134 tempest-TestServerVolumeAttachmentScenario-1784244126 None] attachment_update completed successfully. Jul 09 14:27:32 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-a54eae6b-a903-4671-a450-1d875c5e8b43 req-f9171ee7-aaec-4cb5-9ba4-8dc090a111ec tempest-TestServerVolumeAttachmentScenario-1784244126 None] Terminate volume connection completed successfully. Jul 09 14:27:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-a54eae6b-a903-4671-a450-1d875c5e8b43 req-f9171ee7-aaec-4cb5-9ba4-8dc090a111ec tempest-TestServerVolumeAttachmentScenario-1784244126 None] Deleting attachment e7c8ff9d-0c1f-420b-98b4-36dbae03392c. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:27:35 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-f9eccc3a-eeb0-4e94-8d62-a66b96818383 req-7e752fec-758a-45bf-8504-c27f687be195 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Terminate volume connection completed successfully. Jul 09 14:27:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-f9eccc3a-eeb0-4e94-8d62-a66b96818383 req-7e752fec-758a-45bf-8504-c27f687be195 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Deleting attachment 5b0d81ce-6d41-44c5-a181-2b71690c8e62. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:27:42 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=16,cinder:UPDATE=1 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:27:45 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:27:46 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Acquiring lock "cinder-23266542-be03-481b-8472-72714e06090e-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:27:46 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "cinder-23266542-be03-481b-8472-72714e06090e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:27:46 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Acquiring lock "cinder-quobyte-23266542-be03-481b-8472-72714e06090e" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:27:46 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "cinder-quobyte-23266542-be03-481b-8472-72714e06090e" acquired by "delete_volume" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:27:46 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff531e0-bd94-4dd7-a4a6-3d8cf8882005]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:27:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-23266542-be03-481b-8472-72714e06090e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:27:46 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-23266542-be03-481b-8472-72714e06090e Jul 09 14:27:46 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:27:46 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Jul 09 14:27:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-23266542-be03-481b-8472-72714e06090e" returned: 0 in 0.768s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:27:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-23266542-be03-481b-8472-72714e06090e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:27:46 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-23266542-be03-481b-8472-72714e06090e Jul 09 14:27:46 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:27:47 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Jul 09 14:27:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-23266542-be03-481b-8472-72714e06090e" returned: 0 in 0.670s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:27:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "cinder-quobyte-23266542-be03-481b-8472-72714e06090e" released by "delete_volume" :: held 1.473s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:27:47 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Created reservations ['b491e654-ab8e-40b2-92b7-a6bd13519919', 'c3aaf0d8-32be-4814-a6a5-43e9925c3316', 'c33586cf-673a-4316-a8a5-dbf00f1577a0', 'e0a08b08-8896-4e32-b72c-d9dc8bc12520'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:27:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:27:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:27:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:27:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:27:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:27:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:27:47 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:27:47 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:27:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] Acquiring lock "cinder-8ecf37d0-164c-4c26-bd47-34b37642a4fc-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:27:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "cinder-8ecf37d0-164c-4c26-bd47-34b37642a4fc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:27:48 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Jul 09 14:27:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] Acquiring lock "cinder-quobyte-8ecf37d0-164c-4c26-bd47-34b37642a4fc" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:27:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.659s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:27:48 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:27:48 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Deleted volume successfully. Jul 09 14:27:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "cinder-quobyte-8ecf37d0-164c-4c26-bd47-34b37642a4fc" acquired by "delete_volume" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:27:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b600e05a-43c0-4116-88b0-4b9b61fc3ca2 tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "cinder-23266542-be03-481b-8472-72714e06090e-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:27:48 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[c127c399-f59a-4a73-bd22-402ef1278aa1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:27:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:27:48 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc Jul 09 14:27:48 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:27:49 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Jul 09 14:27:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc" returned: 0 in 0.844s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:27:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:27:49 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc Jul 09 14:27:49 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:27:49 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jul 09 14:27:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-8ecf37d0-164c-4c26-bd47-34b37642a4fc" returned: 0 in 0.632s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:27:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "cinder-quobyte-8ecf37d0-164c-4c26-bd47-34b37642a4fc" released by "delete_volume" :: held 1.521s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:27:49 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] Created reservations ['b0443a4c-8a6b-4797-bb3c-fac7ae185f67', '4c45bb6f-2f72-46f4-af1a-ee25c1041749', '6c884ad9-2ad5-4e90-810d-21dae34a5e4d', '31bcdf55-14da-4322-b2e5-e93308777f83'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:27:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:27:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:27:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:27:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:27:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:27:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:27:50 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:27:50 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:27:50 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Jul 09 14:27:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.687s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:27:50 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:27:50 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] Deleted volume successfully. Jul 09 14:27:50 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c46096e1-98d6-4334-83fa-2752033c586a tempest-TestServerVolumeAttachmentScenario-1784244126 None] Lock "cinder-8ecf37d0-164c-4c26-bd47-34b37642a4fc-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:28:00 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:28:00 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=10,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:28:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:28:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:28:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:28:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:28:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:28:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:28:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:28:12 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:28:12 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:28:13 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jul 09 14:28:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.659s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:28:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:28:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:28:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:28:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:28:19 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:28:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Flow 'volume_create_manager' (b3e0cc5f-b017-497b-9cbb-1d9918f01e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:28:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411a40e0-9a4d-45f0-ba5d-b355902c4830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:28:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411a40e0-9a4d-45f0-ba5d-b355902c4830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1224282563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ade51a-e234-4d6f-9c45-580a22774e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61127c7fd3f3445fa67def6a3affa068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:28:19Z,use_quota=True,user_id='51f9e45540a347c6908f3876fcb124d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:28:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b50627a-3c7a-42b6-aa34-ef41cda0f146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:28:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b50627a-3c7a-42b6-aa34-ef41cda0f146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:28:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eaa2b86-f5a2-420f-b0d4-c59b37e61beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:28:19 devstack cinder-volume[87011]: DEBUG cinder.image.glance [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Creating Keystone auth plugin from conf {{(pid=87011) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 14:28:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eaa2b86-f5a2-420f-b0d4-c59b37e61beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd0ade51a-e234-4d6f-9c45-580a22774e36', 'volume_name': 'volume-d0ade51a-e234-4d6f-9c45-580a22774e36', 'volume_size': 1, 'image_id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c87c562978df4c18bad93b074708151d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'created_at': datetime.datetime(2026, 7, 9, 12, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fed42dad-a967-43d7-aa04-dfd40efa81d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:28:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50b80e2-d4b3-4075-8697-bace58403cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:28:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c50b80e2-d4b3-4075-8697-bace58403cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:28:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5999e440-bd1f-45c7-a77e-27f156c42c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:28:19 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Volume d0ade51a-e234-4d6f-9c45-580a22774e36: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d0ade51a-e234-4d6f-9c45-580a22774e36', 'volume_size': 1, 'image_id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c87c562978df4c18bad93b074708151d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'created_at': datetime.datetime(2026, 7, 9, 12, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fed42dad-a967-43d7-aa04-dfd40efa81d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 14:28:19 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Trying to clone d0ade51a-e234-4d6f-9c45-580a22774e36 from image fed42dad-a967-43d7-aa04-dfd40efa81d3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}]). {{(pid=87011) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 14:28:19 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_2ft7muz4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 14:28:19 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Image download 20.69 MB at 20.69 MB/s Jul 09 14:28:19 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[4848590b-7d4c-44a3-9821-19cbfebeb9c5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:28:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_2ft7muz4devstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:28:19 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_2ft7muz4devstack@QuobyteHD Jul 09 14:28:19 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:28:20 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Jul 09 14:28:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_2ft7muz4devstack@QuobyteHD" returned: 0 in 0.680s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:28:20 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Temporary image fed42dad-a967-43d7-aa04-dfd40efa81d3 is fetched for user 51f9e45540a347c6908f3876fcb124d2. {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 14:28:20 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb3d708-1044-4174-9afb-29f766ab545c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:28:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_2ft7muz4devstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:28:20 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_2ft7muz4devstack@QuobyteHD Jul 09 14:28:20 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:28:21 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Jul 09 14:28:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_2ft7muz4devstack@QuobyteHD" returned: 0 in 0.763s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:28:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:28:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:28:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1224282563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ade51a-e234-4d6f-9c45-580a22774e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61127c7fd3f3445fa67def6a3affa068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:28:19Z,use_quota=True,user_id='51f9e45540a347c6908f3876fcb124d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:28:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Creating volume d0ade51a-e234-4d6f-9c45-580a22774e36 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:28:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:28:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:28:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:28:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:28:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:28:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:28:21 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:28:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:28:21 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 1073741824 Jul 09 14:28:21 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:28:22 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jul 09 14:28:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 1073741824" returned: 0 in 0.843s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:28:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:28:22 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 Jul 09 14:28:22 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:28:22 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Jul 09 14:28:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36" returned: 0 in 0.631s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:28:22 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:28:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:28:22 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Attempting download of fed42dad-a967-43d7-aa04-dfd40efa81d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}])) to volume d0ade51a-e234-4d6f-9c45-580a22774e36. {{(pid=87011) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 14:28:22 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[411eea62-85ad-4a40-9b79-cffdef3880a6]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:28:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_mwzmfa1a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:28:23 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_mwzmfa1a Jul 09 14:28:23 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:28:23 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Jul 09 14:28:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_mwzmfa1a" returned: 0 in 0.701s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:28:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_mwzmfa1a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:28:23 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_mwzmfa1a Jul 09 14:28:23 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:28:24 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Jul 09 14:28:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_mwzmfa1a" returned: 1 in 0.681s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:28:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fed42dad-a967-43d7-aa04-dfd40efa81d3_mwzmfa1a' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:28:24 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[674ac990-4dc3-49a8-be63-a636c069569e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:28:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_2ft7muz4devstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:28:24 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_2ft7muz4devstack@QuobyteHD Jul 09 14:28:24 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:28:25 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Jul 09 14:28:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_2ft7muz4devstack@QuobyteHD" returned: 0 in 0.713s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:28:25 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] fed42dad-a967-43d7-aa04-dfd40efa81d3 was qcow2, converting to raw {{(pid=87011) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 14:28:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_2ft7muz4devstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:28:25 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_2ft7muz4devstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 Jul 09 14:28:25 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:28:26 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Jul 09 14:28:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_2ft7muz4devstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36" returned: 0 in 1.809s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:28:26 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fed42dad-a967-43d7-aa04-dfd40efa81d3_2ft7muz4devstack@QuobyteHD, size 112.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:28:26 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Converted 112.00 MB image at 61.88 MB/s Jul 09 14:28:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:28:26 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 1G Jul 09 14:28:26 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:28:27 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jul 09 14:28:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 1G" returned: 0 in 0.716s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:28:27 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d422553-16a5-439a-b48b-0091d060690c]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:28:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:28:27 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 Jul 09 14:28:27 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:28:28 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 09 14:28:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36" returned: 0 in 0.725s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:28:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:28:28 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 Jul 09 14:28:28 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:28:29 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Jul 09 14:28:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36" returned: 1 in 0.740s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:28:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:28:29 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Downloaded image fed42dad-a967-43d7-aa04-dfd40efa81d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}])) to volume d0ade51a-e234-4d6f-9c45-580a22774e36 successfully. {{(pid=87011) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 14:28:29 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Temporary image fed42dad-a967-43d7-aa04-dfd40efa81d3 for user 51f9e45540a347c6908f3876fcb124d2 is deleted. {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 14:28:29 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Marking volume d0ade51a-e234-4d6f-9c45-580a22774e36 as bootable. {{(pid=87011) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 14:28:29 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Copying metadata from image fed42dad-a967-43d7-aa04-dfd40efa81d3 to d0ade51a-e234-4d6f-9c45-580a22774e36. {{(pid=87011) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 14:28:29 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Creating volume glance metadata for volume d0ade51a-e234-4d6f-9c45-580a22774e36 backed by image fed42dad-a967-43d7-aa04-dfd40efa81d3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87011) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 14:28:29 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5999e440-bd1f-45c7-a77e-27f156c42c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0ade51a-e234-4d6f-9c45-580a22774e36', 'volume_size': 1, 'image_id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fed42dad-a967-43d7-aa04-dfd40efa81d3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c87c562978df4c18bad93b074708151d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fed42dad-a967-43d7-aa04-dfd40efa81d3', 'created_at': datetime.datetime(2026, 7, 9, 12, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fed42dad-a967-43d7-aa04-dfd40efa81d3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:28:29 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2226e1-f1e9-4316-9d4c-42af36d1542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:28:29 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Volume volume-d0ade51a-e234-4d6f-9c45-580a22774e36 (d0ade51a-e234-4d6f-9c45-580a22774e36): created successfully Jul 09 14:28:29 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2226e1-f1e9-4316-9d4c-42af36d1542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:28:29 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Flow 'volume_create_manager' (b3e0cc5f-b017-497b-9cbb-1d9918f01e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:28:29 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-30effac7-986d-4ddc-bada-7053ea7e9c3d tempest-TestShelveInstance-874530785 None] Created volume successfully. Jul 09 14:28:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-082217f5-9745-473d-b994-5ea62c4ab4e0 req-99d6eddb-f98b-468e-820f-8fdf29543547 tempest-TestShelveInstance-874530785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:28:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-082217f5-9745-473d-b994-5ea62c4ab4e0 req-99d6eddb-f98b-468e-820f-8fdf29543547 tempest-TestShelveInstance-874530785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:28:36 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce509a4-e126-4ea6-8b6b-d7077d055158]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:28:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-082217f5-9745-473d-b994-5ea62c4ab4e0 req-99d6eddb-f98b-468e-820f-8fdf29543547 tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:28:36 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 Jul 09 14:28:36 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:28:37 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jul 09 14:28:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-082217f5-9745-473d-b994-5ea62c4ab4e0 req-99d6eddb-f98b-468e-820f-8fdf29543547 tempest-TestShelveInstance-874530785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36" returned: 0 in 0.750s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:28:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-082217f5-9745-473d-b994-5ea62c4ab4e0 req-99d6eddb-f98b-468e-820f-8fdf29543547 tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:28:37 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 Jul 09 14:28:37 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:28:38 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Jul 09 14:28:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-082217f5-9745-473d-b994-5ea62c4ab4e0 req-99d6eddb-f98b-468e-820f-8fdf29543547 tempest-TestShelveInstance-874530785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36" returned: 1 in 0.700s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:28:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-082217f5-9745-473d-b994-5ea62c4ab4e0 req-99d6eddb-f98b-468e-820f-8fdf29543547 tempest-TestShelveInstance-874530785 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:28:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-082217f5-9745-473d-b994-5ea62c4ab4e0 req-99d6eddb-f98b-468e-820f-8fdf29543547 tempest-TestShelveInstance-874530785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.499s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:28:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-082217f5-9745-473d-b994-5ea62c4ab4e0 req-99d6eddb-f98b-468e-820f-8fdf29543547 tempest-TestShelveInstance-874530785 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-d0ade51a-e234-4d6f-9c45-580a22774e36', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8161c25-eedf-4385-8282-ab2c2d19b907', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:28:38 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-082217f5-9745-473d-b994-5ea62c4ab4e0 req-99d6eddb-f98b-468e-820f-8fdf29543547 tempest-TestShelveInstance-874530785 None] attachment_update completed successfully. Jul 09 14:28:48 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=8,cinder:SELECT=12,cinder:INSERT=9 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:28:48 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=18,cinder:UPDATE=4,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:28:58 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:29:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:29:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:29:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:29:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:29:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:29:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:29:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:29:12 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:29:12 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:29:13 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jul 09 14:29:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.680s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:29:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:29:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:29:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:29:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:29:14 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-cca66599-6280-483a-8a2b-2ed81be9f583 req-0955240b-3d8a-4a3e-8e96-a6e8cf5c4fa5 tempest-TestShelveInstance-874530785 None] Terminate volume connection completed successfully. Jul 09 14:29:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-cca66599-6280-483a-8a2b-2ed81be9f583 req-0955240b-3d8a-4a3e-8e96-a6e8cf5c4fa5 tempest-TestShelveInstance-874530785 None] Deleting attachment d8161c25-eedf-4385-8282-ab2c2d19b907. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:29:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-8e7645ff-3f3c-4e19-a286-86e818044994 req-936d591c-6662-452f-b586-32a5e3f33dd4 tempest-TestShelveInstance-874530785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:29:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-8e7645ff-3f3c-4e19-a286-86e818044994 req-936d591c-6662-452f-b586-32a5e3f33dd4 tempest-TestShelveInstance-874530785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:29:18 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac2e15d-4f94-40a3-9b3b-798de581d0b8]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:29:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-8e7645ff-3f3c-4e19-a286-86e818044994 req-936d591c-6662-452f-b586-32a5e3f33dd4 tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:29:19 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 Jul 09 14:29:19 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:29:19 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jul 09 14:29:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-8e7645ff-3f3c-4e19-a286-86e818044994 req-936d591c-6662-452f-b586-32a5e3f33dd4 tempest-TestShelveInstance-874530785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36" returned: 0 in 0.755s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:29:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-8e7645ff-3f3c-4e19-a286-86e818044994 req-936d591c-6662-452f-b586-32a5e3f33dd4 tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:29:19 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 Jul 09 14:29:19 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:29:20 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jul 09 14:29:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-8e7645ff-3f3c-4e19-a286-86e818044994 req-936d591c-6662-452f-b586-32a5e3f33dd4 tempest-TestShelveInstance-874530785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36" returned: 1 in 0.758s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:29:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-8e7645ff-3f3c-4e19-a286-86e818044994 req-936d591c-6662-452f-b586-32a5e3f33dd4 tempest-TestShelveInstance-874530785 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:29:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-8e7645ff-3f3c-4e19-a286-86e818044994 req-936d591c-6662-452f-b586-32a5e3f33dd4 tempest-TestShelveInstance-874530785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.563s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:29:20 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-8e7645ff-3f3c-4e19-a286-86e818044994 req-936d591c-6662-452f-b586-32a5e3f33dd4 tempest-TestShelveInstance-874530785 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610', 'name': 'volume-d0ade51a-e234-4d6f-9c45-580a22774e36', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ede6a85-54dd-4a09-a061-bcee9f4acf85', 'enforce_multipath': True} {{(pid=87011) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 14:29:20 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-8e7645ff-3f3c-4e19-a286-86e818044994 req-936d591c-6662-452f-b586-32a5e3f33dd4 tempest-TestShelveInstance-874530785 None] attachment_update completed successfully. Jul 09 14:29:30 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:29:30 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:30:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:30:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:30:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:30:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:12 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:30:12 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:13 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.611s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:30:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:30:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:30:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:30:13 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-d88c938e-19ef-4f1c-8e8c-786fb494d9ef tempest-TestShelveInstance-874530785 None] Terminate volume connection completed successfully. Jul 09 14:30:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-d88c938e-19ef-4f1c-8e8c-786fb494d9ef tempest-TestShelveInstance-874530785 None] Deleting attachment 6ede6a85-54dd-4a09-a061-bcee9f4acf85. {{(pid=87011) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 14:30:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] Acquiring lock "cinder-d0ade51a-e234-4d6f-9c45-580a22774e36-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:30:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] Lock "cinder-d0ade51a-e234-4d6f-9c45-580a22774e36-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:30:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] Acquiring lock "cinder-quobyte-d0ade51a-e234-4d6f-9c45-580a22774e36" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:30:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] Lock "cinder-quobyte-d0ade51a-e234-4d6f-9c45-580a22774e36" acquired by "delete_volume" :: waited 0.014s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:30:14 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e4d209-3c80-4f41-83c8-89901a7de0ff]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:30:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:14 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 Jul 09 14:30:14 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:15 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36" returned: 0 in 0.772s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:15 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 Jul 09 14:30:15 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:15 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36" returned: 1 in 0.731s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:30:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:15 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36 Jul 09 14:30:15 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:16 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d0ade51a-e234-4d6f-9c45-580a22774e36" returned: 0 in 0.649s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] Lock "cinder-quobyte-d0ade51a-e234-4d6f-9c45-580a22774e36" released by "delete_volume" :: held 2.221s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:30:16 devstack cinder-volume[87011]: DEBUG cinder.quota [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] Created reservations ['f260f5e3-faf9-494e-ba15-64aa76bd114a', '9b2f4157-1f44-4f93-9dd9-46a441316316', 'c3e53a50-8c25-4c25-b9bb-52c379f9c844', '6940e8c8-c1ba-4b62-861b-5bb2a0ecd05f'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:30:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:30:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:30:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:16 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:30:16 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:17 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.638s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:17 devstack cinder-volume[87011]: DEBUG cinder.manager [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:30:17 devstack cinder-volume[87011]: INFO cinder.volume.manager [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] Deleted volume successfully. Jul 09 14:30:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [req-b6d0432e-e0af-4e34-99a7-8dbb8dd74ef6 req-8851eb29-c992-4053-8ff6-31df047b417c tempest-TestShelveInstance-874530785 None] Lock "cinder-d0ade51a-e234-4d6f-9c45-580a22774e36-delete_volume" released by "delete_volume" :: held 3.051s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:30:26 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=3 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:30:27 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Flow 'volume_create_manager' (41dc77db-a1f1-442b-b96a-3941ebbdddf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a761f7-f649-4f04-b46d-3df23554aed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a761f7-f649-4f04-b46d-3df23554aed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-750481546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d237f2bb-9a10-4e89-b82f-0407b922f58a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d84cc5590724277a50ac81f92bd5592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:30:29Z,use_quota=True,user_id='73f2f8266dc042a3a17f1518af8a55af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24724dd-3762-4ec5-9156-008c48f55065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24724dd-3762-4ec5-9156-008c48f55065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cb3a50-6b6d-41c5-ba01-4755f9f38187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cb3a50-6b6d-41c5-ba01-4755f9f38187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd237f2bb-9a10-4e89-b82f-0407b922f58a', 'volume_name': 'volume-d237f2bb-9a10-4e89-b82f-0407b922f58a', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ceb31e4-532b-4e00-9445-141e386f07a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ceb31e4-532b-4e00-9445-141e386f07a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5684202-30ec-4ccc-9af5-cf21f3d61c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:28 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Volume d237f2bb-9a10-4e89-b82f-0407b922f58a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d237f2bb-9a10-4e89-b82f-0407b922f58a', 'volume_size': 1} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-750481546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d237f2bb-9a10-4e89-b82f-0407b922f58a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d84cc5590724277a50ac81f92bd5592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:30:29Z,use_quota=True,user_id='73f2f8266dc042a3a17f1518af8a55af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Creating volume d237f2bb-9a10-4e89-b82f-0407b922f58a {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:30:28 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:30:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237f2bb-9a10-4e89-b82f-0407b922f58a 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:28 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237f2bb-9a10-4e89-b82f-0407b922f58a 1073741824 Jul 09 14:30:28 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:29 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237f2bb-9a10-4e89-b82f-0407b922f58a 1073741824" returned: 0 in 0.771s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237f2bb-9a10-4e89-b82f-0407b922f58a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:29 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237f2bb-9a10-4e89-b82f-0407b922f58a Jul 09 14:30:29 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:30 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237f2bb-9a10-4e89-b82f-0407b922f58a" returned: 0 in 0.645s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:30 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:30:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5684202-30ec-4ccc-9af5-cf21f3d61c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d237f2bb-9a10-4e89-b82f-0407b922f58a', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b9e6e1-77b6-4278-9bac-fb4c2a74a82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:30 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Volume volume-d237f2bb-9a10-4e89-b82f-0407b922f58a (d237f2bb-9a10-4e89-b82f-0407b922f58a): created successfully Jul 09 14:30:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b9e6e1-77b6-4278-9bac-fb4c2a74a82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:30 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Flow 'volume_create_manager' (41dc77db-a1f1-442b-b96a-3941ebbdddf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:30:30 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c579231d-ef88-4196-b500-01c33b012b66 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Created volume successfully. Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Flow 'volume_create_manager' (4ebe09d5-b743-45f0-8d9c-8058da1e6d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08493fb4-4b90-4eea-8c5f-88cf0cdb281d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08493fb4-4b90-4eea-8c5f-88cf0cdb281d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-645595660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e88b874-6c50-4509-81b3-39d111e6fae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d84cc5590724277a50ac81f92bd5592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:30:31Z,use_quota=True,user_id='73f2f8266dc042a3a17f1518af8a55af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a67beac-96e0-41bd-9889-9cd0c6eba12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a67beac-96e0-41bd-9889-9cd0c6eba12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41406e7-a653-4498-b0fe-465566633aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41406e7-a653-4498-b0fe-465566633aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e88b874-6c50-4509-81b3-39d111e6fae7', 'volume_name': 'volume-6e88b874-6c50-4509-81b3-39d111e6fae7', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28099b4-bbf4-4b50-bc3a-630cc027c896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28099b4-bbf4-4b50-bc3a-630cc027c896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537d6575-a164-4397-b04f-6d0fd9ce49c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:31 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Volume 6e88b874-6c50-4509-81b3-39d111e6fae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e88b874-6c50-4509-81b3-39d111e6fae7', 'volume_size': 1} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-645595660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e88b874-6c50-4509-81b3-39d111e6fae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d84cc5590724277a50ac81f92bd5592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:30:31Z,use_quota=True,user_id='73f2f8266dc042a3a17f1518af8a55af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Creating volume 6e88b874-6c50-4509-81b3-39d111e6fae7 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:30:31 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e88b874-6c50-4509-81b3-39d111e6fae7 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:31 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e88b874-6c50-4509-81b3-39d111e6fae7 1073741824 Jul 09 14:30:31 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Flow 'volume_create_manager' (a62a2222-4a74-4926-93f4-2235ba8a2e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1bc460-fb26-46fd-ba91-1c641a065a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1bc460-fb26-46fd-ba91-1c641a065a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2009204872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04b8146-38d7-4894-be6a-fe4a6dc31182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d84cc5590724277a50ac81f92bd5592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:30:31Z,use_quota=True,user_id='73f2f8266dc042a3a17f1518af8a55af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d6be3e-ceeb-42fb-99c0-ef325bc19888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d6be3e-ceeb-42fb-99c0-ef325bc19888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8645278c-11fb-4b06-8306-459098946c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8645278c-11fb-4b06-8306-459098946c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04b8146-38d7-4894-be6a-fe4a6dc31182', 'volume_name': 'volume-d04b8146-38d7-4894-be6a-fe4a6dc31182', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ece66b-d184-43e1-aee1-96df8fe0cb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ece66b-d184-43e1-aee1-96df8fe0cb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294188d4-405b-405b-b645-9d09ee9e4ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:31 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Volume d04b8146-38d7-4894-be6a-fe4a6dc31182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04b8146-38d7-4894-be6a-fe4a6dc31182', 'volume_size': 1} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Flow 'volume_create_manager' (76d9b794-8fc2-44ea-94c2-2a17ff1ab38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a93d355-04de-472b-b903-9bb3550b9945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a93d355-04de-472b-b903-9bb3550b9945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-330355155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f171323e-0b3f-41c6-a45a-c29408f8f30f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d84cc5590724277a50ac81f92bd5592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:30:32Z,use_quota=True,user_id='73f2f8266dc042a3a17f1518af8a55af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ee71ec-b55a-4a6d-ac30-7ee9bf2a9be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ee71ec-b55a-4a6d-ac30-7ee9bf2a9be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d349ca-cc23-4fc3-aa14-76aa876fb89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d349ca-cc23-4fc3-aa14-76aa876fb89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f171323e-0b3f-41c6-a45a-c29408f8f30f', 'volume_name': 'volume-f171323e-0b3f-41c6-a45a-c29408f8f30f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc380eb-c877-48f7-b97d-28c0476d114f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc380eb-c877-48f7-b97d-28c0476d114f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074a7dad-72bd-482e-bdf4-0b9142f7d1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:31 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Volume f171323e-0b3f-41c6-a45a-c29408f8f30f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f171323e-0b3f-41c6-a45a-c29408f8f30f', 'volume_size': 1} Jul 09 14:30:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:32 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Flow 'volume_create_manager' (229e9eae-9d10-4424-88f5-6e26f3062700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1551f990-43ce-4db3-a241-1e112803337f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e88b874-6c50-4509-81b3-39d111e6fae7 1073741824" returned: 0 in 1.031s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1551f990-43ce-4db3-a241-1e112803337f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1013934966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76292b05-dae9-4527-b917-65af3058636e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d84cc5590724277a50ac81f92bd5592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:30:32Z,use_quota=True,user_id='73f2f8266dc042a3a17f1518af8a55af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d291ce25-5aa1-48d8-addd-903aee4e61bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d291ce25-5aa1-48d8-addd-903aee4e61bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59f3559-a44b-4bd9-8147-3558732a8fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59f3559-a44b-4bd9-8147-3558732a8fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76292b05-dae9-4527-b917-65af3058636e', 'volume_name': 'volume-76292b05-dae9-4527-b917-65af3058636e', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832fd924-c368-4571-b2ee-514e93dafc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832fd924-c368-4571-b2ee-514e93dafc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab142b9-3d89-42b0-8d11-1114d89d4042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:32 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Volume 76292b05-dae9-4527-b917-65af3058636e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76292b05-dae9-4527-b917-65af3058636e', 'volume_size': 1} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e88b874-6c50-4509-81b3-39d111e6fae7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:32 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e88b874-6c50-4509-81b3-39d111e6fae7 Jul 09 14:30:32 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Flow 'volume_create_manager' (d0877a30-70c1-4be9-ad8e-793e3cb30740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa8ee1b-7e12-47d5-846c-407fa0ce586e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa8ee1b-7e12-47d5-846c-407fa0ce586e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1364294686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0824965a-063b-4194-9198-102380a26209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d84cc5590724277a50ac81f92bd5592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:30:33Z,use_quota=True,user_id='73f2f8266dc042a3a17f1518af8a55af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd20bc6f-5e14-4a18-ba09-c7e0496d1cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd20bc6f-5e14-4a18-ba09-c7e0496d1cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1fae78b-4512-4e5a-9b8b-c891e7df5559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1fae78b-4512-4e5a-9b8b-c891e7df5559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0824965a-063b-4194-9198-102380a26209', 'volume_name': 'volume-0824965a-063b-4194-9198-102380a26209', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02be517b-4c22-4ac0-81a7-f53db8883fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02be517b-4c22-4ac0-81a7-f53db8883fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d82a0c-e72d-46f6-85eb-2c2c05078635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:32 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Volume 0824965a-063b-4194-9198-102380a26209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0824965a-063b-4194-9198-102380a26209', 'volume_size': 1} Jul 09 14:30:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:33 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e88b874-6c50-4509-81b3-39d111e6fae7" returned: 0 in 0.797s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:30:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.602s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2009204872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04b8146-38d7-4894-be6a-fe4a6dc31182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d84cc5590724277a50ac81f92bd5592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:30:31Z,use_quota=True,user_id='73f2f8266dc042a3a17f1518af8a55af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:30:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Creating volume d04b8146-38d7-4894-be6a-fe4a6dc31182 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:30:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:30:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:30:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:30:33 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:30:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d04b8146-38d7-4894-be6a-fe4a6dc31182 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (537d6575-a164-4397-b04f-6d0fd9ce49c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e88b874-6c50-4509-81b3-39d111e6fae7', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:33 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d04b8146-38d7-4894-be6a-fe4a6dc31182 1073741824 Jul 09 14:30:33 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27ac292-8c0a-4b72-a2ec-8ea409e16adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:33 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Volume volume-6e88b874-6c50-4509-81b3-39d111e6fae7 (6e88b874-6c50-4509-81b3-39d111e6fae7): created successfully Jul 09 14:30:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27ac292-8c0a-4b72-a2ec-8ea409e16adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:33 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Flow 'volume_create_manager' (4ebe09d5-b743-45f0-8d9c-8058da1e6d01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:30:33 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-e7f17a58-129c-4585-b64e-d1a9478880e5 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Created volume successfully. Jul 09 14:30:34 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d04b8146-38d7-4894-be6a-fe4a6dc31182 1073741824" returned: 0 in 0.888s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d04b8146-38d7-4894-be6a-fe4a6dc31182 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:34 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d04b8146-38d7-4894-be6a-fe4a6dc31182 Jul 09 14:30:34 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:34 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d04b8146-38d7-4894-be6a-fe4a6dc31182" returned: 0 in 0.687s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.906s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-330355155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f171323e-0b3f-41c6-a45a-c29408f8f30f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d84cc5590724277a50ac81f92bd5592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:30:32Z,use_quota=True,user_id='73f2f8266dc042a3a17f1518af8a55af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Creating volume f171323e-0b3f-41c6-a45a-c29408f8f30f {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:30:34 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f171323e-0b3f-41c6-a45a-c29408f8f30f 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294188d4-405b-405b-b645-9d09ee9e4ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04b8146-38d7-4894-be6a-fe4a6dc31182', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:34 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f171323e-0b3f-41c6-a45a-c29408f8f30f 1073741824 Jul 09 14:30:34 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0ebc9b-5711-4888-a5de-9dc22cd94656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:34 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Volume volume-d04b8146-38d7-4894-be6a-fe4a6dc31182 (d04b8146-38d7-4894-be6a-fe4a6dc31182): created successfully Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0ebc9b-5711-4888-a5de-9dc22cd94656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Flow 'volume_create_manager' (a62a2222-4a74-4926-93f4-2235ba8a2e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:30:34 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-e287855a-2258-47ca-a1cc-eae1b01727a1 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Created volume successfully. Jul 09 14:30:35 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f171323e-0b3f-41c6-a45a-c29408f8f30f 1073741824" returned: 0 in 0.885s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f171323e-0b3f-41c6-a45a-c29408f8f30f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:35 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f171323e-0b3f-41c6-a45a-c29408f8f30f Jul 09 14:30:35 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:36 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f171323e-0b3f-41c6-a45a-c29408f8f30f" returned: 0 in 0.710s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:30:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.123s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1013934966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76292b05-dae9-4527-b917-65af3058636e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d84cc5590724277a50ac81f92bd5592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:30:32Z,use_quota=True,user_id='73f2f8266dc042a3a17f1518af8a55af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:30:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Creating volume 76292b05-dae9-4527-b917-65af3058636e {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:30:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:30:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:30:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:30:36 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:30:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-76292b05-dae9-4527-b917-65af3058636e 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:36 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-76292b05-dae9-4527-b917-65af3058636e 1073741824 Jul 09 14:30:36 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074a7dad-72bd-482e-bdf4-0b9142f7d1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f171323e-0b3f-41c6-a45a-c29408f8f30f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c21a57-1a5e-47f8-85da-f2315070d449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:36 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Volume volume-f171323e-0b3f-41c6-a45a-c29408f8f30f (f171323e-0b3f-41c6-a45a-c29408f8f30f): created successfully Jul 09 14:30:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c21a57-1a5e-47f8-85da-f2315070d449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Flow 'volume_create_manager' (76d9b794-8fc2-44ea-94c2-2a17ff1ab38b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:30:36 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-0d63b72d-3c49-447d-84a7-58a8eddbd343 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Created volume successfully. Jul 09 14:30:37 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-76292b05-dae9-4527-b917-65af3058636e 1073741824" returned: 0 in 0.899s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-76292b05-dae9-4527-b917-65af3058636e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:37 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-76292b05-dae9-4527-b917-65af3058636e Jul 09 14:30:37 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:38 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-76292b05-dae9-4527-b917-65af3058636e" returned: 0 in 0.702s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.236s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1364294686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0824965a-063b-4194-9198-102380a26209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d84cc5590724277a50ac81f92bd5592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:30:33Z,use_quota=True,user_id='73f2f8266dc042a3a17f1518af8a55af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Creating volume 0824965a-063b-4194-9198-102380a26209 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:30:38 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0824965a-063b-4194-9198-102380a26209 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab142b9-3d89-42b0-8d11-1114d89d4042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76292b05-dae9-4527-b917-65af3058636e', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:38 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0824965a-063b-4194-9198-102380a26209 1073741824 Jul 09 14:30:38 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae26f49b-5347-4a96-8779-936cd8e46708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:38 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Volume volume-76292b05-dae9-4527-b917-65af3058636e (76292b05-dae9-4527-b917-65af3058636e): created successfully Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae26f49b-5347-4a96-8779-936cd8e46708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Flow 'volume_create_manager' (229e9eae-9d10-4424-88f5-6e26f3062700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:30:38 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-65d4d080-5d5e-4310-b4a5-a7096af0a7aa tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Created volume successfully. Jul 09 14:30:38 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0824965a-063b-4194-9198-102380a26209 1073741824" returned: 0 in 0.809s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0824965a-063b-4194-9198-102380a26209 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:39 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0824965a-063b-4194-9198-102380a26209 Jul 09 14:30:39 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:39 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0824965a-063b-4194-9198-102380a26209" returned: 0 in 0.731s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:30:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d82a0c-e72d-46f6-85eb-2c2c05078635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0824965a-063b-4194-9198-102380a26209', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ee128e-7b82-4a0d-ad24-24a7b7439b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:39 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Volume volume-0824965a-063b-4194-9198-102380a26209 (0824965a-063b-4194-9198-102380a26209): created successfully Jul 09 14:30:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ee128e-7b82-4a0d-ad24-24a7b7439b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Flow 'volume_create_manager' (d0877a30-70c1-4be9-ad8e-793e3cb30740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:30:39 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-8d7efd26-2f30-468a-aec9-525e49a3fa04 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Created volume successfully. Jul 09 14:30:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "cinder-0824965a-063b-4194-9198-102380a26209-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:30:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-0824965a-063b-4194-9198-102380a26209-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:30:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "cinder-quobyte-0824965a-063b-4194-9198-102380a26209" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:30:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-quobyte-0824965a-063b-4194-9198-102380a26209" acquired by "delete_volume" :: waited 0.014s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:30:40 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1588c0-1d4f-4100-b8d1-f9c1440403e6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:30:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0824965a-063b-4194-9198-102380a26209 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:40 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0824965a-063b-4194-9198-102380a26209 Jul 09 14:30:40 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:41 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0824965a-063b-4194-9198-102380a26209" returned: 0 in 0.731s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0824965a-063b-4194-9198-102380a26209 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:41 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0824965a-063b-4194-9198-102380a26209 Jul 09 14:30:41 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:41 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0824965a-063b-4194-9198-102380a26209" returned: 0 in 0.636s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:41 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-quobyte-0824965a-063b-4194-9198-102380a26209" released by "delete_volume" :: held 1.407s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:30:42 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Created reservations ['f15f2e26-c75f-4129-a285-e5f8a5428ef1', 'a2649c05-b430-47fd-9186-9bb8b9580d36', 'fcd58f21-2035-4e38-a799-bc3776bb2ba4', 'd297aa7d-4db9-4966-8248-bebb0752ad83'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:30:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:30:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:30:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:42 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:30:42 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:42 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.633s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:42 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:30:42 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Deleted volume successfully. Jul 09 14:30:42 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "cinder-76292b05-dae9-4527-b917-65af3058636e-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:30:42 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-76292b05-dae9-4527-b917-65af3058636e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:30:42 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-21cca9d8-7a91-4f2a-ba72-22e76da337ab tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-0824965a-063b-4194-9198-102380a26209-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:30:42 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "cinder-quobyte-76292b05-dae9-4527-b917-65af3058636e" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:30:42 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-quobyte-76292b05-dae9-4527-b917-65af3058636e" acquired by "delete_volume" :: waited 0.014s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:30:42 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ed44e4-6fe7-427c-a8f2-6ba6903bbc06]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:30:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-76292b05-dae9-4527-b917-65af3058636e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:42 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-76292b05-dae9-4527-b917-65af3058636e Jul 09 14:30:42 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:43 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-76292b05-dae9-4527-b917-65af3058636e" returned: 0 in 0.738s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-76292b05-dae9-4527-b917-65af3058636e {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:43 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-76292b05-dae9-4527-b917-65af3058636e Jul 09 14:30:43 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:44 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-76292b05-dae9-4527-b917-65af3058636e" returned: 0 in 0.619s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:44 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-quobyte-76292b05-dae9-4527-b917-65af3058636e" released by "delete_volume" :: held 1.399s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:30:44 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Created reservations ['48225ee3-d9f1-4f4b-8fd7-a2963da5ca40', 'b0c3065a-f1a8-46a3-8058-f6897dfdc740', '204081f0-ed40-4d1d-9cc3-8b5804d1dca0', '0605ca0e-bd97-4fa1-8dcb-70e269b03f60'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:30:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:30:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:30:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:44 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:30:44 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:44 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "cinder-f171323e-0b3f-41c6-a45a-c29408f8f30f-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:30:44 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-f171323e-0b3f-41c6-a45a-c29408f8f30f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:30:45 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "cinder-quobyte-f171323e-0b3f-41c6-a45a-c29408f8f30f" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:30:45 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.693s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:45 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:30:45 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-quobyte-f171323e-0b3f-41c6-a45a-c29408f8f30f" acquired by "delete_volume" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:30:45 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Deleted volume successfully. Jul 09 14:30:45 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd3a8dd-f55d-4af5-8e57-36c497db9e36]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:30:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f171323e-0b3f-41c6-a45a-c29408f8f30f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:45 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5280c68a-b884-4e29-9865-f5a2ef7c670f tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-76292b05-dae9-4527-b917-65af3058636e-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:30:45 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f171323e-0b3f-41c6-a45a-c29408f8f30f Jul 09 14:30:45 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:45 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f171323e-0b3f-41c6-a45a-c29408f8f30f" returned: 0 in 0.751s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f171323e-0b3f-41c6-a45a-c29408f8f30f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:45 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f171323e-0b3f-41c6-a45a-c29408f8f30f Jul 09 14:30:45 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:46 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-f171323e-0b3f-41c6-a45a-c29408f8f30f" returned: 0 in 0.698s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:46 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-quobyte-f171323e-0b3f-41c6-a45a-c29408f8f30f" released by "delete_volume" :: held 1.487s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:30:46 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Created reservations ['c86c80aa-044a-448b-a41f-5b0b093d47b8', 'e58ac73b-7ffc-4134-8f65-124a3a684826', '018cbcaa-40c6-46c8-b8cc-061452c03572', '3d865efe-674e-4068-bf99-bc5c6398833a'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:30:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:30:46 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:30:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:46 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:30:46 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "cinder-d04b8146-38d7-4894-be6a-fe4a6dc31182-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:30:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-d04b8146-38d7-4894-be6a-fe4a6dc31182-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:30:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "cinder-quobyte-d04b8146-38d7-4894-be6a-fe4a6dc31182" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:30:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-quobyte-d04b8146-38d7-4894-be6a-fe4a6dc31182" acquired by "delete_volume" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:30:47 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.677s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:47 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:30:47 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Deleted volume successfully. Jul 09 14:30:47 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae28299-0ccf-4a5f-aadc-9edaf409c498]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:30:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d04b8146-38d7-4894-be6a-fe4a6dc31182 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-bf8ed5c9-f43c-4ff5-8403-2676c7c5c9e3 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-f171323e-0b3f-41c6-a45a-c29408f8f30f-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:30:47 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d04b8146-38d7-4894-be6a-fe4a6dc31182 Jul 09 14:30:47 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:48 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d04b8146-38d7-4894-be6a-fe4a6dc31182" returned: 0 in 0.722s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d04b8146-38d7-4894-be6a-fe4a6dc31182 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:48 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d04b8146-38d7-4894-be6a-fe4a6dc31182 Jul 09 14:30:48 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:48 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d04b8146-38d7-4894-be6a-fe4a6dc31182" returned: 0 in 0.633s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-quobyte-d04b8146-38d7-4894-be6a-fe4a6dc31182" released by "delete_volume" :: held 1.397s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:30:48 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Created reservations ['f4bb827c-5972-4fce-b9be-8ad6d1dceac5', 'c3d957e9-1c7e-44e6-9430-2f3b5d547a04', '3756e91f-d0cd-4f81-861b-d18bcf079db9', 'f05993a5-6376-4f1a-bfd1-f2e44eb27f2b'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:30:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:30:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:30:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:48 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:30:48 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "cinder-6e88b874-6c50-4509-81b3-39d111e6fae7-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:30:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-6e88b874-6c50-4509-81b3-39d111e6fae7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:30:49 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.641s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:49 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:30:49 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Deleted volume successfully. Jul 09 14:30:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0856073c-ed7e-46cb-b38b-90a0648c6a83 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-d04b8146-38d7-4894-be6a-fe4a6dc31182-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:30:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "cinder-quobyte-6e88b874-6c50-4509-81b3-39d111e6fae7" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:30:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-quobyte-6e88b874-6c50-4509-81b3-39d111e6fae7" acquired by "delete_volume" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:30:49 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf29038-361f-4a50-807c-d8093224fe9e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:30:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e88b874-6c50-4509-81b3-39d111e6fae7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:49 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e88b874-6c50-4509-81b3-39d111e6fae7 Jul 09 14:30:49 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:50 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e88b874-6c50-4509-81b3-39d111e6fae7" returned: 0 in 0.711s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e88b874-6c50-4509-81b3-39d111e6fae7 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:50 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e88b874-6c50-4509-81b3-39d111e6fae7 Jul 09 14:30:50 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:50 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e88b874-6c50-4509-81b3-39d111e6fae7" returned: 0 in 0.606s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:50 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-quobyte-6e88b874-6c50-4509-81b3-39d111e6fae7" released by "delete_volume" :: held 1.353s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:30:50 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Created reservations ['59306ffa-5056-4ff2-a739-0353420355a3', '52022df4-96ee-4d3e-91ac-29fe7c9cee3b', '35aee7ec-5dde-4bb9-9536-b59fe669204a', 'c52ef72e-eb2d-4b37-8171-dd75a1ebe5be'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:30:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:30:51 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:30:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:51 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:30:51 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:51 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.624s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:51 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:30:51 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Deleted volume successfully. Jul 09 14:30:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9d9a3089-c701-4fa9-a517-8586667aa476 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-6e88b874-6c50-4509-81b3-39d111e6fae7-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:30:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "cinder-d237f2bb-9a10-4e89-b82f-0407b922f58a-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:30:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-d237f2bb-9a10-4e89-b82f-0407b922f58a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:30:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "cinder-quobyte-d237f2bb-9a10-4e89-b82f-0407b922f58a" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:30:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-quobyte-d237f2bb-9a10-4e89-b82f-0407b922f58a" acquired by "delete_volume" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:30:51 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22f2571-5a51-417e-9612-298d425afcd0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:30:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237f2bb-9a10-4e89-b82f-0407b922f58a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:51 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237f2bb-9a10-4e89-b82f-0407b922f58a Jul 09 14:30:51 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:52 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237f2bb-9a10-4e89-b82f-0407b922f58a" returned: 0 in 0.772s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237f2bb-9a10-4e89-b82f-0407b922f58a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:52 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237f2bb-9a10-4e89-b82f-0407b922f58a Jul 09 14:30:52 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:53 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d237f2bb-9a10-4e89-b82f-0407b922f58a" returned: 0 in 0.659s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-quobyte-d237f2bb-9a10-4e89-b82f-0407b922f58a" released by "delete_volume" :: held 1.467s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:30:53 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Created reservations ['67448049-79d8-46ac-9523-9322c9c2da0a', '51537633-3892-4cfe-b07f-21a5bd6b59dc', '665b8363-81b6-4d95-a3c4-17372e58c7b0', 'eda0cc48-fadc-4c19-a514-44835675c36c'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:30:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:30:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:30:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:53 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:30:53 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:54 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.677s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:54 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:30:54 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Deleted volume successfully. Jul 09 14:30:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d77c55eb-4258-459c-92b7-4ea24607b589 tempest-CreateVolumesFromSourceVolumeTest-155692116 None] Lock "cinder-d237f2bb-9a10-4e89-b82f-0407b922f58a-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Flow 'volume_create_manager' (516c9c67-24af-42b8-97a9-c39941539773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d69081-b4f0-4f63-a4cc-74138e13ca57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d69081-b4f0-4f63-a4cc-74138e13ca57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-458754632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451d90384e1b437989415e840c9a9d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:30:57Z,use_quota=True,user_id='b8a6cdace84a43819e8b1e99ed1d9983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f11b0a-3298-4f70-b2ac-533f8b86e962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f11b0a-3298-4f70-b2ac-533f8b86e962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cce8ab-4b3b-428e-8576-6af2143d3068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cce8ab-4b3b-428e-8576-6af2143d3068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47', 'volume_name': 'volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55de377b-eda3-475a-96bf-af0ffbfc6741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55de377b-eda3-475a-96bf-af0ffbfc6741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f1bffa0-4e27-44f5-b018-fa8619a017e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:56 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Volume e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47', 'volume_size': 1} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-458754632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451d90384e1b437989415e840c9a9d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:30:57Z,use_quota=True,user_id='b8a6cdace84a43819e8b1e99ed1d9983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Creating volume e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:30:56 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:30:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:56 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 1073741824 Jul 09 14:30:56 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:57 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 1073741824" returned: 0 in 0.830s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:57 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 Jul 09 14:30:57 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:58 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47" returned: 0 in 0.657s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:30:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:30:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f1bffa0-4e27-44f5-b018-fa8619a017e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cefa41-1aad-47bd-ab48-9739fc994775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:30:58 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Volume volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 (e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47): created successfully Jul 09 14:30:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cefa41-1aad-47bd-ab48-9739fc994775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:30:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Flow 'volume_create_manager' (516c9c67-24af-42b8-97a9-c39941539773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:30:58 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-db70d373-e43d-41cd-afae-01db7003345a tempest-VolumeDependencyTests-281950961 None] Created volume successfully. Jul 09 14:30:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:30:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:30:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] Creating offline snapshot 32370656-35b6-4b84-a9f5-560d10e75636 of volume e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:30:59 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd3a07b-d1ab-4517-bf20-098f4869cde2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:30:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:59 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 Jul 09 14:30:59 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:30:59 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 09 14:30:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47" returned: 0 in 0.751s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:30:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:30:59 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636 1G Jul 09 14:30:59 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:00 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636 1G" returned: 0 in 0.787s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:00 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636 Jul 09 14:31:00 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:01 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636" returned: 0 in 0.679s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:01 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636 is being set with open permissions: ugo+rw Jul 09 14:31:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:01 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636 Jul 09 14:31:01 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:01 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636" returned: 0 in 0.628s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:01 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.info Jul 09 14:31:01 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:02 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.info" returned: 0 in 0.666s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:02 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.info is being set with open permissions: ugo+rw Jul 09 14:31:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:02 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.info Jul 09 14:31:02 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:03 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.info" returned: 0 in 0.691s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.292s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:03 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-2f6952de-6e35-4812-83c5-2bd37614f2fe tempest-VolumeDependencyTests-281950961 None] Create snapshot completed successfully Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Flow 'volume_create_manager' (693ab4fb-8532-4558-a1ba-8d21a8eeb37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e6d8af-2cf8-4657-b9f4-dc0c166e58ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e6d8af-2cf8-4657-b9f4-dc0c166e58ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-5318769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44850b49-2105-43cf-8225-fd9f26f9af35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451d90384e1b437989415e840c9a9d3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=32370656-35b6-4b84-a9f5-560d10e75636,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:05Z,use_quota=True,user_id='b8a6cdace84a43819e8b1e99ed1d9983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bcc712-f783-4590-9d41-9583a1e0ca10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73bcc712-f783-4590-9d41-9583a1e0ca10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e442850b-1dfa-4197-b456-eb04a904b434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e442850b-1dfa-4197-b456-eb04a904b434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '44850b49-2105-43cf-8225-fd9f26f9af35', 'volume_name': 'volume-44850b49-2105-43cf-8225-fd9f26f9af35', 'volume_size': 1, 'snapshot_id': '32370656-35b6-4b84-a9f5-560d10e75636'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429cb735-5f0f-4cbc-957a-5166b09db99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429cb735-5f0f-4cbc-957a-5166b09db99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82e1ede-7a4f-4584-a838-1b73e16bb869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:04 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Volume 44850b49-2105-43cf-8225-fd9f26f9af35: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-44850b49-2105-43cf-8225-fd9f26f9af35', 'volume_size': 1, 'snapshot_id': '32370656-35b6-4b84-a9f5-560d10e75636'} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Acquiring lock "cinder-quobyte-32370656-35b6-4b84-a9f5-560d10e75636-44850b49-2105-43cf-8225-fd9f26f9af35" by "_create_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Lock "cinder-quobyte-32370656-35b6-4b84-a9f5-560d10e75636-44850b49-2105-43cf-8225-fd9f26f9af35" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Creating volume 44850b49-2105-43cf-8225-fd9f26f9af35 from snapshot 32370656-35b6-4b84-a9f5-560d10e75636 {{(pid=87011) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Acquiring lock "cinder-quobyte-44850b49-2105-43cf-8225-fd9f26f9af35" by "_copy_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Lock "cinder-quobyte-44850b49-2105-43cf-8225-fd9f26f9af35" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] snapshot: 32370656-35b6-4b84-a9f5-560d10e75636, volume: 44850b49-2105-43cf-8225-fd9f26f9af35, {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc62d9c8-3519-4be7-abc1-118004f0a42e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:31:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:05 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636 Jul 09 14:31:05 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:05 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636" returned: 0 in 0.797s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:31:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 14:31:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Creating direct copy from snapshot {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 14:31:05 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0ee12b-3016-4e4d-8f54-929bdf06e735]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:31:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:05 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 Jul 09 14:31:05 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:06 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47" returned: 0 in 0.754s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:06 devstack cinder-volume[87011]: DEBUG cinder.utils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Path /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-44850b49-2105-43cf-8225-fd9f26f9af35 not found in is_blk_device check {{(pid=87011) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 14:31:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-44850b49-2105-43cf-8225-fd9f26f9af35 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:06 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-44850b49-2105-43cf-8225-fd9f26f9af35 Jul 09 14:31:06 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:10 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-44850b49-2105-43cf-8225-fd9f26f9af35" returned: 0 in 4.464s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:10 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[94811ca6-537d-4a34-9e1e-714cb020c24c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:31:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:11 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 Jul 09 14:31:11 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:11 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47" returned: 0 in 0.917s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:11 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47, size 1024.00 MB, duration 4.47 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-44850b49-2105-43cf-8225-fd9f26f9af35 {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:31:11 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Converted 1024.00 MB image at 229.31 MB/s Jul 09 14:31:11 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-44850b49-2105-43cf-8225-fd9f26f9af35 is being set with open permissions: ugo+rw Jul 09 14:31:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-44850b49-2105-43cf-8225-fd9f26f9af35 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:11 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-44850b49-2105-43cf-8225-fd9f26f9af35 Jul 09 14:31:11 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:12 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-44850b49-2105-43cf-8225-fd9f26f9af35" returned: 0 in 0.618s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Lock "cinder-quobyte-44850b49-2105-43cf-8225-fd9f26f9af35" released by "_copy_volume_from_snapshot" :: held 7.639s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:31:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Lock "cinder-quobyte-32370656-35b6-4b84-a9f5-560d10e75636-44850b49-2105-43cf-8225-fd9f26f9af35" released by "_create_volume_from_snapshot" :: held 7.669s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:31:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.690s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82e1ede-7a4f-4584-a838-1b73e16bb869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44850b49-2105-43cf-8225-fd9f26f9af35', 'volume_size': 1, 'snapshot_id': '32370656-35b6-4b84-a9f5-560d10e75636'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d2280c-c7a7-43ad-a654-cad9ac90827c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:31:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:31:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:31:12 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Volume volume-44850b49-2105-43cf-8225-fd9f26f9af35 (44850b49-2105-43cf-8225-fd9f26f9af35): created successfully Jul 09 14:31:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d2280c-c7a7-43ad-a654-cad9ac90827c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Flow 'volume_create_manager' (693ab4fb-8532-4558-a1ba-8d21a8eeb37c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:12 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-77254910-dfca-4ed1-a1c2-7cfcf33ff22b tempest-VolumeDependencyTests-281950961 None] Created volume successfully. Jul 09 14:31:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] Acquiring lock "cinder-32370656-35b6-4b84-a9f5-560d10e75636-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] Lock "cinder-32370656-35b6-4b84-a9f5-560d10e75636-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] Acquiring lock "cinder-quobyte-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] Lock "cinder-quobyte-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] Acquiring lock "cinder-quobyte-32370656-35b6-4b84-a9f5-560d10e75636" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] Lock "cinder-quobyte-32370656-35b6-4b84-a9f5-560d10e75636" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:13 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] Deleting offline snapshot 32370656-35b6-4b84-a9f5-560d10e75636 of volume e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:31:13 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] snapshot_file for this snap is: volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:31:13 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4818b9-1cee-42d9-b583-468de7871274]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:31:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:13 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636 Jul 09 14:31:13 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:14 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636" returned: 0 in 0.764s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:31:14 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff93bed5-2341-43ad-b25b-b58fcbd01e30]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:31:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:14 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 Jul 09 14:31:14 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:14 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47" returned: 0 in 0.765s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:14 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636 Jul 09 14:31:14 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:15 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636" returned: 0 in 0.739s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:15 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636 Jul 09 14:31:15 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:16 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47.32370656-35b6-4b84-a9f5-560d10e75636" returned: 0 in 0.625s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] Lock "cinder-quobyte-32370656-35b6-4b84-a9f5-560d10e75636" released by "_delete_snapshot" :: held 2.985s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:31:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] Lock "cinder-quobyte-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47" released by "delete_snapshot" :: held 3.009s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:31:16 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] Created reservations ['b71599b5-bc9c-48bd-bafe-2032e8c7582f', '556f6b44-111a-4efe-b5bd-37b667af62eb', 'b573f94e-6d6d-46ef-a6a5-24cc703f8c78', '48e60749-ab3e-4d23-b20c-0479acf42c3c'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:31:16 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] Delete snapshot completed successfully. Jul 09 14:31:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c6a7c66c-ef3c-4441-91d1-e298b71e7ca0 tempest-VolumeDependencyTests-281950961 None] Lock "cinder-32370656-35b6-4b84-a9f5-560d10e75636-delete_snapshot" released by "delete_snapshot" :: held 3.149s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:31:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] Acquiring lock "cinder-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] Lock "cinder-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] Acquiring lock "cinder-quobyte-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] Lock "cinder-quobyte-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47" acquired by "delete_volume" :: waited 0.014s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:17 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[090e41a3-e09a-4f23-9989-c7b7b9aa474c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:31:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:17 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 Jul 09 14:31:17 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:18 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47" returned: 0 in 0.810s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:18 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47 Jul 09 14:31:18 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:19 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47" returned: 0 in 0.705s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] Lock "cinder-quobyte-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47" released by "delete_volume" :: held 1.576s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:31:19 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] Created reservations ['a11c3bc3-658c-4885-b68b-635ee172365d', '4feef067-d272-4bfe-943c-1618ac58303b', '2859cec1-eefe-47f0-828c-d20db83fd22d', 'b73eae1c-d25b-43c9-9738-646edb029876'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:31:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:19 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:31:19 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] Acquiring lock "cinder-44850b49-2105-43cf-8225-fd9f26f9af35-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] Lock "cinder-44850b49-2105-43cf-8225-fd9f26f9af35-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] Acquiring lock "cinder-quobyte-44850b49-2105-43cf-8225-fd9f26f9af35" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] Lock "cinder-quobyte-44850b49-2105-43cf-8225-fd9f26f9af35" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:19 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[051e5bdb-159c-4e6e-8104-b8b9bb1fa31f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:31:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-44850b49-2105-43cf-8225-fd9f26f9af35 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:20 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.723s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:20 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:31:20 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-44850b49-2105-43cf-8225-fd9f26f9af35 Jul 09 14:31:20 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:20 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] Deleted volume successfully. Jul 09 14:31:20 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-7ce5c9e3-2d75-448f-8b1e-348cc7f0f3e1 tempest-VolumeDependencyTests-281950961 None] Lock "cinder-e3267ad4-4b76-4ccf-8fb0-7a6862aa6e47-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:31:20 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-44850b49-2105-43cf-8225-fd9f26f9af35" returned: 0 in 0.780s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-44850b49-2105-43cf-8225-fd9f26f9af35 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:20 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-44850b49-2105-43cf-8225-fd9f26f9af35 Jul 09 14:31:20 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:21 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-44850b49-2105-43cf-8225-fd9f26f9af35" returned: 0 in 0.683s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] Lock "cinder-quobyte-44850b49-2105-43cf-8225-fd9f26f9af35" released by "delete_volume" :: held 1.510s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:31:21 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] Created reservations ['45e7ae85-65af-4cbf-aea8-191bf7e388eb', 'b0f34e32-f59e-4ba5-8cdd-f1e3133c7eba', '208ba570-e5d2-4819-8797-f2532abffe5e', '68c17027-dcce-480d-88a1-3e3ad8c38839'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:31:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:21 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:31:21 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:22 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.709s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:22 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:31:22 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] Deleted volume successfully. Jul 09 14:31:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c8c370e5-2ec5-4723-8184-86c8fa32bbd9 tempest-VolumeDependencyTests-281950961 None] Lock "cinder-44850b49-2105-43cf-8225-fd9f26f9af35-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:31:31 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=72,cinder:UPDATE=92,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:31:32 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=60,cinder:UPDATE=97,cinder:INSERT=22,cinder:DELETE=9 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Flow 'volume_create_manager' (77996d04-5e22-438f-a63f-5307ae0a010b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53b0258-294e-4125-ac5d-0395d1e1c108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53b0258-294e-4125-ac5d-0395d1e1c108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-681217393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b53f912-4571-4c95-8c0b-40a21d3bcc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acec37a7c5f4b50ab4ea571dd7de048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:38Z,use_quota=True,user_id='75a9c4bb6ffd4679b5f33c6e1fe1316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff65d666-c235-4b62-971f-7a711c554772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff65d666-c235-4b62-971f-7a711c554772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9514418-706f-41de-9433-0165fd201913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9514418-706f-41de-9433-0165fd201913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b53f912-4571-4c95-8c0b-40a21d3bcc6b', 'volume_name': 'volume-2b53f912-4571-4c95-8c0b-40a21d3bcc6b', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f03520-ba8c-4c57-a57c-af9362315dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74f03520-ba8c-4c57-a57c-af9362315dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48ce6b7-b4e2-4180-a829-95d28304c1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:38 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Volume 2b53f912-4571-4c95-8c0b-40a21d3bcc6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b53f912-4571-4c95-8c0b-40a21d3bcc6b', 'volume_size': 1} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-681217393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b53f912-4571-4c95-8c0b-40a21d3bcc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acec37a7c5f4b50ab4ea571dd7de048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:38Z,use_quota=True,user_id='75a9c4bb6ffd4679b5f33c6e1fe1316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Creating volume 2b53f912-4571-4c95-8c0b-40a21d3bcc6b {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:31:38 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b53f912-4571-4c95-8c0b-40a21d3bcc6b 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:38 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b53f912-4571-4c95-8c0b-40a21d3bcc6b 1073741824 Jul 09 14:31:38 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Flow 'volume_create_manager' (1916cd1c-38ee-4bb6-ae8b-66bb06c0b9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea928df-6219-4f13-b68b-823849cb66f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea928df-6219-4f13-b68b-823849cb66f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-646991187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33f5c48-d372-493f-87c2-bd94d3bafc34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960cf65f81c04359a60d1034aee2b327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:39Z,use_quota=True,user_id='b988c002ba2049d392b2c762646a20d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bf7321-248e-47a7-8e63-efc283e4d67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bf7321-248e-47a7-8e63-efc283e4d67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e883c64d-c529-48fb-bcbc-6b729980cc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e883c64d-c529-48fb-bcbc-6b729980cc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c33f5c48-d372-493f-87c2-bd94d3bafc34', 'volume_name': 'volume-c33f5c48-d372-493f-87c2-bd94d3bafc34', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26950a74-72a9-4cd8-8373-8546a2b3a4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26950a74-72a9-4cd8-8373-8546a2b3a4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef84c07d-855b-478b-8b6a-0adb2cd4cc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:38 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Volume c33f5c48-d372-493f-87c2-bd94d3bafc34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c33f5c48-d372-493f-87c2-bd94d3bafc34', 'volume_size': 1} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Flow 'volume_create_manager' (134b0366-8da1-4a7e-a579-51e64d986dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3d1188-103a-49a6-8f33-d8de709f738a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb3d1188-103a-49a6-8f33-d8de709f738a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-607517639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acec37a7c5f4b50ab4ea571dd7de048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:39Z,use_quota=True,user_id='75a9c4bb6ffd4679b5f33c6e1fe1316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80aaa698-21e1-43a3-a06f-3eb78689bb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80aaa698-21e1-43a3-a06f-3eb78689bb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170cae1a-3818-437e-9621-31304d71360b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170cae1a-3818-437e-9621-31304d71360b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2', 'volume_name': 'volume-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41518408-87b8-4b14-81f8-6017973a04a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41518408-87b8-4b14-81f8-6017973a04a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e1e065-de51-4b59-86a2-0c376944a182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:38 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Volume dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2', 'volume_size': 1} Jul 09 14:31:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Flow 'volume_create_manager' (5fb2c53a-6faa-42cc-ba9e-63c290da2409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe69fc1-ab14-433f-8af2-57e51aab20b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe69fc1-ab14-433f-8af2-57e51aab20b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1808931561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b6d363-d4f4-4d2b-8207-c78abc563fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eed8f2acd6a4274a728283c9d3c7370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:39Z,use_quota=True,user_id='bb30a73ed0414192b08205eb3ca6c2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d570e3-b7fe-4f5d-aac9-6d9f8fa6ab30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d570e3-b7fe-4f5d-aac9-6d9f8fa6ab30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdd4dc1-da6d-4284-83c9-2249079831d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bdd4dc1-da6d-4284-83c9-2249079831d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5b6d363-d4f4-4d2b-8207-c78abc563fc2', 'volume_name': 'volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aea6383-179e-46cd-886d-437d1816cb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aea6383-179e-46cd-886d-437d1816cb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f65f312-718d-4582-9762-ba36ff365e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:39 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Volume d5b6d363-d4f4-4d2b-8207-c78abc563fc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2', 'volume_size': 1} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Flow 'volume_create_manager' (96824442-cc0d-4c22-98fa-315fa2055818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b8ea3d-1ea9-4621-b655-4cf40f134509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b8ea3d-1ea9-4621-b655-4cf40f134509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1649639783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=960e4d83-b860-48a7-825d-3b953ddf03a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acec37a7c5f4b50ab4ea571dd7de048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:39Z,use_quota=True,user_id='75a9c4bb6ffd4679b5f33c6e1fe1316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb53817-7a15-47d9-a37a-0e2cfc2a9cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb53817-7a15-47d9-a37a-0e2cfc2a9cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d7274a-8275-4eb6-9679-fa252f5fd4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22d7274a-8275-4eb6-9679-fa252f5fd4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '960e4d83-b860-48a7-825d-3b953ddf03a5', 'volume_name': 'volume-960e4d83-b860-48a7-825d-3b953ddf03a5', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ec969e0-efd3-47db-939b-eba378d13a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ec969e0-efd3-47db-939b-eba378d13a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef30c438-e33e-48b5-a9d3-d02d52e1311d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:39 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Volume 960e4d83-b860-48a7-825d-3b953ddf03a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-960e4d83-b860-48a7-825d-3b953ddf03a5', 'volume_size': 1} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Flow 'volume_create_manager' (da49a2e4-e4e5-4893-b023-91e93434ec7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b46059b-8fee-40f9-8b9c-778237ea8e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b46059b-8fee-40f9-8b9c-778237ea8e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1168369180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8a62b4-8cc4-4f87-8a30-8229b526eeed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acec37a7c5f4b50ab4ea571dd7de048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:40Z,use_quota=True,user_id='75a9c4bb6ffd4679b5f33c6e1fe1316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8159eb41-c1b2-4bde-83f5-fd86e503ac47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8159eb41-c1b2-4bde-83f5-fd86e503ac47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e050582-6660-40f8-b0d4-8c8733ab72c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e050582-6660-40f8-b0d4-8c8733ab72c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad8a62b4-8cc4-4f87-8a30-8229b526eeed', 'volume_name': 'volume-ad8a62b4-8cc4-4f87-8a30-8229b526eeed', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8cf189e-40c4-4699-889d-7ef5d33fb5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8cf189e-40c4-4699-889d-7ef5d33fb5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1982d88d-880d-47b4-a562-dcf08884200f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:39 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Volume ad8a62b4-8cc4-4f87-8a30-8229b526eeed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad8a62b4-8cc4-4f87-8a30-8229b526eeed', 'volume_size': 1} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:39 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b53f912-4571-4c95-8c0b-40a21d3bcc6b 1073741824" returned: 0 in 1.222s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b53f912-4571-4c95-8c0b-40a21d3bcc6b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:39 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b53f912-4571-4c95-8c0b-40a21d3bcc6b Jul 09 14:31:39 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Flow 'volume_create_manager' (991709a9-b147-42e4-9354-b7801da150a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e9db27b-76ac-41cf-9c30-395b26ebe061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e9db27b-76ac-41cf-9c30-395b26ebe061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-339632204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912aa166-6b92-4aff-a217-2a2cf82c7833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acec37a7c5f4b50ab4ea571dd7de048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:40Z,use_quota=True,user_id='75a9c4bb6ffd4679b5f33c6e1fe1316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c726c90b-1bb4-4607-83f3-12e4313f3316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c726c90b-1bb4-4607-83f3-12e4313f3316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c611f17-75ff-4615-a8b3-564e45d4d85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c611f17-75ff-4615-a8b3-564e45d4d85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '912aa166-6b92-4aff-a217-2a2cf82c7833', 'volume_name': 'volume-912aa166-6b92-4aff-a217-2a2cf82c7833', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (671c17e6-9292-4865-9491-0dbd55761d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (671c17e6-9292-4865-9491-0dbd55761d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924fadf2-e3e1-4abc-9648-ef5d45e386c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:40 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Volume 912aa166-6b92-4aff-a217-2a2cf82c7833: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-912aa166-6b92-4aff-a217-2a2cf82c7833', 'volume_size': 1} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:40 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b53f912-4571-4c95-8c0b-40a21d3bcc6b" returned: 0 in 0.682s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.805s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-646991187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33f5c48-d372-493f-87c2-bd94d3bafc34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960cf65f81c04359a60d1034aee2b327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:39Z,use_quota=True,user_id='b988c002ba2049d392b2c762646a20d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Creating volume c33f5c48-d372-493f-87c2-bd94d3bafc34 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:31:40 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c33f5c48-d372-493f-87c2-bd94d3bafc34 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:40 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c33f5c48-d372-493f-87c2-bd94d3bafc34 1073741824 Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48ce6b7-b4e2-4180-a829-95d28304c1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b53f912-4571-4c95-8c0b-40a21d3bcc6b', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:40 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fbd0c1c-bdd1-4e91-828a-06f6b51b63fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:40 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Volume volume-2b53f912-4571-4c95-8c0b-40a21d3bcc6b (2b53f912-4571-4c95-8c0b-40a21d3bcc6b): created successfully Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fbd0c1c-bdd1-4e91-828a-06f6b51b63fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Flow 'volume_create_manager' (77996d04-5e22-438f-a63f-5307ae0a010b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:40 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-376a2970-fadf-4a11-aa02-2d63f25e61fd tempest-CreateVolumesFromImageTest-528366832 None] Created volume successfully. Jul 09 14:31:41 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c33f5c48-d372-493f-87c2-bd94d3bafc34 1073741824" returned: 0 in 0.870s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c33f5c48-d372-493f-87c2-bd94d3bafc34 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:41 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c33f5c48-d372-493f-87c2-bd94d3bafc34 Jul 09 14:31:41 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:42 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c33f5c48-d372-493f-87c2-bd94d3bafc34" returned: 0 in 0.654s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.237s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-607517639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acec37a7c5f4b50ab4ea571dd7de048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:39Z,use_quota=True,user_id='75a9c4bb6ffd4679b5f33c6e1fe1316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Creating volume dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:31:42 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef84c07d-855b-478b-8b6a-0adb2cd4cc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c33f5c48-d372-493f-87c2-bd94d3bafc34', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:42 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2 1073741824 Jul 09 14:31:42 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439ad2b7-5e10-4332-b63e-4cdcf74acdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:42 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Volume volume-c33f5c48-d372-493f-87c2-bd94d3bafc34 (c33f5c48-d372-493f-87c2-bd94d3bafc34): created successfully Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439ad2b7-5e10-4332-b63e-4cdcf74acdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Flow 'volume_create_manager' (1916cd1c-38ee-4bb6-ae8b-66bb06c0b9bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:42 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-878f0733-e854-4167-8ab8-e86a32d7ef39 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Created volume successfully. Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Flow 'volume_create_manager' (8d01f545-23ed-4441-a179-3d4b8e32ef4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af75dc0-0167-4a3f-86c1-6d8cd92e03cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af75dc0-0167-4a3f-86c1-6d8cd92e03cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d076e22-b2dc-4f9c-8a0a-894587a6d59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2b026d06b2437fab679feb71276a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:42Z,use_quota=True,user_id='c20131dd687f49c4bd92b4935c385965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a5e2ea5-086c-4f74-add4-40413f27eda8),volume_type_id=3a5e2ea5-086c-4f74-add4-40413f27eda8)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8fc4c4a-c8de-4a42-af6b-af8ffd7497e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8fc4c4a-c8de-4a42-af6b-af8ffd7497e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f7b338e-bc02-4847-990d-ab113bab2276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.image.glance [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Creating Keystone auth plugin from conf {{(pid=87011) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f7b338e-bc02-4847-990d-ab113bab2276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7d076e22-b2dc-4f9c-8a0a-894587a6d59f', 'volume_name': 'volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f', 'volume_size': 1, 'image_id': '90e9e03a-6462-4ab9-879f-feea7bc9a72e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90e9e03a-6462-4ab9-879f-feea7bc9a72e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a4e54df7e02894e5551120ec4026d3c6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5d2b026d06b2437fab679feb71276a43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '72376ea5b22b4afbbe0e887a615837c79c1762d89869b616bf60c66d80bd53d5ec60429629a4dca3c5f381ba7e5a8487d4a47ab9cbd4f585c27b16cae4cbbc05', 'id': '90e9e03a-6462-4ab9-879f-feea7bc9a72e', 'created_at': datetime.datetime(2026, 7, 9, 12, 31, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 31, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90e9e03a-6462-4ab9-879f-feea7bc9a72e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ac18eb-0a22-4a3a-b629-ca62cafbbf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ac18eb-0a22-4a3a-b629-ca62cafbbf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28427f8-4e5c-4fc8-b845-af189c97aa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:42 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Volume 7d076e22-b2dc-4f9c-8a0a-894587a6d59f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f', 'volume_size': 1, 'image_id': '90e9e03a-6462-4ab9-879f-feea7bc9a72e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90e9e03a-6462-4ab9-879f-feea7bc9a72e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a4e54df7e02894e5551120ec4026d3c6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5d2b026d06b2437fab679feb71276a43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '72376ea5b22b4afbbe0e887a615837c79c1762d89869b616bf60c66d80bd53d5ec60429629a4dca3c5f381ba7e5a8487d4a47ab9cbd4f585c27b16cae4cbbc05', 'id': '90e9e03a-6462-4ab9-879f-feea7bc9a72e', 'created_at': datetime.datetime(2026, 7, 9, 12, 31, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 31, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90e9e03a-6462-4ab9-879f-feea7bc9a72e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Trying to clone 7d076e22-b2dc-4f9c-8a0a-894587a6d59f from image 90e9e03a-6462-4ab9-879f-feea7bc9a72e at location (None, [{'url': 'file:///opt/stack/data/glance/images/90e9e03a-6462-4ab9-879f-feea7bc9a72e', 'metadata': {}}]). {{(pid=87011) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 14:31:42 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Image download 0.00 MB at 0.00 MB/s Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df10ceb-a26a-49f6-adfe-f4a7e62d635a]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:31:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:43 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD Jul 09 14:31:43 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:43 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2 1073741824" returned: 0 in 0.941s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:43 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2 Jul 09 14:31:43 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Flow 'volume_create_manager' (e4604640-1596-4dbb-9dc7-39a606daf20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82252b72-e2b2-4265-ba6b-c2f3becd7248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82252b72-e2b2-4265-ba6b-c2f3becd7248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561240474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df060d2-a00c-4127-8613-eec81ae6c716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960cf65f81c04359a60d1034aee2b327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:43Z,use_quota=True,user_id='b988c002ba2049d392b2c762646a20d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf07e51-4739-45ea-b96c-6131f21e1d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf07e51-4739-45ea-b96c-6131f21e1d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500046cc-784d-4d8a-8398-436f85a1d34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500046cc-784d-4d8a-8398-436f85a1d34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5df060d2-a00c-4127-8613-eec81ae6c716', 'volume_name': 'volume-5df060d2-a00c-4127-8613-eec81ae6c716', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37029017-81b9-4729-a388-97095e4f828c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37029017-81b9-4729-a388-97095e4f828c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabc7d7e-01ad-4f0d-95e3-969e5bfbceb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:43 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Volume 5df060d2-a00c-4127-8613-eec81ae6c716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5df060d2-a00c-4127-8613-eec81ae6c716', 'volume_size': 1} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Flow 'volume_create_manager' (b6a09e0a-48ab-48cc-a762-84d3d1342a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc044d5-982b-4333-9be5-54358990fdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc044d5-982b-4333-9be5-54358990fdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1030677744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960cf65f81c04359a60d1034aee2b327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:44Z,use_quota=True,user_id='b988c002ba2049d392b2c762646a20d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5567e3c5-07ea-43f0-82a9-d8b676f510f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5567e3c5-07ea-43f0-82a9-d8b676f510f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:43 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40bc6c27-4cf5-49f5-82d3-2d595d175a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40bc6c27-4cf5-49f5-82d3-2d595d175a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1', 'volume_name': 'volume-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ffdcb2-de8c-49f8-a924-048fda009d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ffdcb2-de8c-49f8-a924-048fda009d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ce86e0-c26c-496f-b25c-4e0bfb2fe95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:43 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Volume 31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1', 'volume_size': 1} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD" returned: 0 in 1.003s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:43 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2" returned: 0 in 0.818s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:31:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.548s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1808931561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b6d363-d4f4-4d2b-8207-c78abc563fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eed8f2acd6a4274a728283c9d3c7370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:39Z,use_quota=True,user_id='bb30a73ed0414192b08205eb3ca6c2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Creating volume d5b6d363-d4f4-4d2b-8207-c78abc563fc2 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:31:44 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:44 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD Jul 09 14:31:44 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:44 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2 1073741824 Jul 09 14:31:44 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e1e065-de51-4b59-86a2-0c376944a182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb988929-ca38-4a0a-99c1-dacea49d9e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:44 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Volume volume-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2 (dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2): created successfully Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb988929-ca38-4a0a-99c1-dacea49d9e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Flow 'volume_create_manager' (134b0366-8da1-4a7e-a579-51e64d986dd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:44 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-089688b5-fbae-471e-9c90-fa29650d3903 tempest-CreateVolumesFromImageTest-528366832 None] Created volume successfully. Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Flow 'volume_create_manager' (7aa47168-f540-48ca-8507-fef3d81ab274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b22b071-c25a-42c6-bc82-829455231514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b22b071-c25a-42c6-bc82-829455231514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1298414893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21fa9892-b645-4ced-9d78-71022bb868c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960cf65f81c04359a60d1034aee2b327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:44Z,use_quota=True,user_id='b988c002ba2049d392b2c762646a20d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2594d0-8114-42e6-b23e-f67f467eac66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2594d0-8114-42e6-b23e-f67f467eac66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62fb092-cc63-4f5a-8907-4ac528309d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62fb092-cc63-4f5a-8907-4ac528309d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21fa9892-b645-4ced-9d78-71022bb868c1', 'volume_name': 'volume-21fa9892-b645-4ced-9d78-71022bb868c1', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0ce99c-2a35-4c6d-871f-c90ae0253ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0ce99c-2a35-4c6d-871f-c90ae0253ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83b6140-3401-46c3-92a0-d8b9230d3ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:44 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Volume 21fa9892-b645-4ced-9d78-71022bb868c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21fa9892-b645-4ced-9d78-71022bb868c1', 'volume_size': 1} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Flow 'volume_create_manager' (71a46b04-2584-486d-9df7-99981a99fbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3193ab-3840-42db-9a9a-16b3ff9b243b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3193ab-3840-42db-9a9a-16b3ff9b243b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1160490498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c38db3-dbf8-46fc-9eec-222f6c3736da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960cf65f81c04359a60d1034aee2b327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:45Z,use_quota=True,user_id='b988c002ba2049d392b2c762646a20d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2e509c-b3c3-4ae3-9a23-f4d9ef3943b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2e509c-b3c3-4ae3-9a23-f4d9ef3943b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246e5c09-5d69-45e3-a14d-c07ee6aadb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246e5c09-5d69-45e3-a14d-c07ee6aadb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c38db3-dbf8-46fc-9eec-222f6c3736da', 'volume_name': 'volume-c6c38db3-dbf8-46fc-9eec-222f6c3736da', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c6b3b2-183b-450c-bc1d-dd297129fd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c6b3b2-183b-450c-bc1d-dd297129fd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0ea996-1730-460b-9942-d95943e6ef89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:44 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Volume c6c38db3-dbf8-46fc-9eec-222f6c3736da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c38db3-dbf8-46fc-9eec-222f6c3736da', 'volume_size': 1} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:44 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD" returned: 1 in 0.940s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Temporary image 90e9e03a-6462-4ab9-879f-feea7bc9a72e is fetched for user c20131dd687f49c4bd92b4935c385965. {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3a85a1-c9a1-4317-8c20-55a420ac825e]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:31:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:45 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2 1073741824" returned: 0 in 1.069s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:31:45 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD Jul 09 14:31:45 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Flow 'volume_create_manager' (7505ec39-9411-40a8-a0e7-c9d3e5ee6c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533a5a46-1efe-430e-a466-ef04ee5ada5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533a5a46-1efe-430e-a466-ef04ee5ada5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1091866627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9b50ee-e7c4-42f6-aaad-ba56f286506b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960cf65f81c04359a60d1034aee2b327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:45Z,use_quota=True,user_id='b988c002ba2049d392b2c762646a20d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca99334-8f52-4e7f-8d19-4a35017b601e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca99334-8f52-4e7f-8d19-4a35017b601e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58931d0-4b2c-4125-bf1b-ad77fdff30b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58931d0-4b2c-4125-bf1b-ad77fdff30b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b9b50ee-e7c4-42f6-aaad-ba56f286506b', 'volume_name': 'volume-2b9b50ee-e7c4-42f6-aaad-ba56f286506b', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a7937d-7d27-42d4-ac6e-51c7a06cde61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a7937d-7d27-42d4-ac6e-51c7a06cde61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90417eb-3b46-4264-9449-64f580ca6eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:45 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Volume 2b9b50ee-e7c4-42f6-aaad-ba56f286506b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b9b50ee-e7c4-42f6-aaad-ba56f286506b', 'volume_size': 1} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:45 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2 Jul 09 14:31:45 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:45 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD" returned: 0 in 0.765s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:45 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2" returned: 0 in 0.649s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.189s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1649639783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=960e4d83-b860-48a7-825d-3b953ddf03a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acec37a7c5f4b50ab4ea571dd7de048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:39Z,use_quota=True,user_id='75a9c4bb6ffd4679b5f33c6e1fe1316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Creating volume 960e4d83-b860-48a7-825d-3b953ddf03a5 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:31:45 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-960e4d83-b860-48a7-825d-3b953ddf03a5 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:45 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD Jul 09 14:31:45 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:45 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-960e4d83-b860-48a7-825d-3b953ddf03a5 1073741824 Jul 09 14:31:45 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f65f312-718d-4582-9762-ba36ff365e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e38ec5-4f34-475b-9737-8275d3e3dc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:45 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Volume volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2 (d5b6d363-d4f4-4d2b-8207-c78abc563fc2): created successfully Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e38ec5-4f34-475b-9737-8275d3e3dc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:45 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Flow 'volume_create_manager' (5fb2c53a-6faa-42cc-ba9e-63c290da2409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:45 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c2102cab-d80f-4d78-b618-74c14ce5848b tempest-CreateVolumesFromSnapshotTest-1829441460 None] Created volume successfully. Jul 09 14:31:46 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD" returned: 1 in 0.728s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:31:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:46 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-960e4d83-b860-48a7-825d-3b953ddf03a5 1073741824" returned: 0 in 0.792s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-960e4d83-b860-48a7-825d-3b953ddf03a5 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:46 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-960e4d83-b860-48a7-825d-3b953ddf03a5 Jul 09 14:31:46 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:47 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-960e4d83-b860-48a7-825d-3b953ddf03a5" returned: 0 in 0.656s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:31:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.547s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1168369180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8a62b4-8cc4-4f87-8a30-8229b526eeed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acec37a7c5f4b50ab4ea571dd7de048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:40Z,use_quota=True,user_id='75a9c4bb6ffd4679b5f33c6e1fe1316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:31:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Creating volume ad8a62b4-8cc4-4f87-8a30-8229b526eeed {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:31:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:31:47 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:31:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ad8a62b4-8cc4-4f87-8a30-8229b526eeed 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef30c438-e33e-48b5-a9d3-d02d52e1311d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-960e4d83-b860-48a7-825d-3b953ddf03a5', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:47 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ad8a62b4-8cc4-4f87-8a30-8229b526eeed 1073741824 Jul 09 14:31:47 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2a2b9b-4967-4fae-b815-4b28418ecbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:47 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Volume volume-960e4d83-b860-48a7-825d-3b953ddf03a5 (960e4d83-b860-48a7-825d-3b953ddf03a5): created successfully Jul 09 14:31:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2a2b9b-4967-4fae-b815-4b28418ecbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:47 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Flow 'volume_create_manager' (96824442-cc0d-4c22-98fa-315fa2055818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:47 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-0e301e49-027a-4b09-afb3-627647959abe tempest-CreateVolumesFromImageTest-528366832 None] Created volume successfully. Jul 09 14:31:48 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ad8a62b4-8cc4-4f87-8a30-8229b526eeed 1073741824" returned: 0 in 0.830s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ad8a62b4-8cc4-4f87-8a30-8229b526eeed {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:48 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ad8a62b4-8cc4-4f87-8a30-8229b526eeed Jul 09 14:31:48 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:48 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ad8a62b4-8cc4-4f87-8a30-8229b526eeed" returned: 0 in 0.631s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.585s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-339632204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912aa166-6b92-4aff-a217-2a2cf82c7833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acec37a7c5f4b50ab4ea571dd7de048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:40Z,use_quota=True,user_id='75a9c4bb6ffd4679b5f33c6e1fe1316d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Creating volume 912aa166-6b92-4aff-a217-2a2cf82c7833 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:31:48 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-912aa166-6b92-4aff-a217-2a2cf82c7833 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:48 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-912aa166-6b92-4aff-a217-2a2cf82c7833 1073741824 Jul 09 14:31:48 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1982d88d-880d-47b4-a562-dcf08884200f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad8a62b4-8cc4-4f87-8a30-8229b526eeed', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2498848a-cee5-4261-aac1-51fe110c2bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:48 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Volume volume-ad8a62b4-8cc4-4f87-8a30-8229b526eeed (ad8a62b4-8cc4-4f87-8a30-8229b526eeed): created successfully Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2498848a-cee5-4261-aac1-51fe110c2bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Flow 'volume_create_manager' (da49a2e4-e4e5-4893-b023-91e93434ec7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:48 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-581a6145-0ed4-4a4d-ab09-63a48b863aca tempest-CreateVolumesFromImageTest-528366832 None] Created volume successfully. Jul 09 14:31:49 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-912aa166-6b92-4aff-a217-2a2cf82c7833 1073741824" returned: 0 in 0.908s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-912aa166-6b92-4aff-a217-2a2cf82c7833 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:49 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-912aa166-6b92-4aff-a217-2a2cf82c7833 Jul 09 14:31:49 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:50 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-912aa166-6b92-4aff-a217-2a2cf82c7833" returned: 0 in 0.671s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:31:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.932s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561240474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df060d2-a00c-4127-8613-eec81ae6c716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960cf65f81c04359a60d1034aee2b327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:43Z,use_quota=True,user_id='b988c002ba2049d392b2c762646a20d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:31:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Creating volume 5df060d2-a00c-4127-8613-eec81ae6c716 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:31:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:31:50 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:31:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5df060d2-a00c-4127-8613-eec81ae6c716 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924fadf2-e3e1-4abc-9648-ef5d45e386c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-912aa166-6b92-4aff-a217-2a2cf82c7833', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc448eed-0b70-4a04-afbb-f90a2c3e886e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:50 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5df060d2-a00c-4127-8613-eec81ae6c716 1073741824 Jul 09 14:31:50 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:50 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Volume volume-912aa166-6b92-4aff-a217-2a2cf82c7833 (912aa166-6b92-4aff-a217-2a2cf82c7833): created successfully Jul 09 14:31:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc448eed-0b70-4a04-afbb-f90a2c3e886e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Flow 'volume_create_manager' (991709a9-b147-42e4-9354-b7801da150a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:50 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-4c7a6ef0-88d2-489f-903b-77e24efc501c tempest-CreateVolumesFromImageTest-528366832 None] Created volume successfully. Jul 09 14:31:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "cinder-912aa166-6b92-4aff-a217-2a2cf82c7833-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-912aa166-6b92-4aff-a217-2a2cf82c7833-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "cinder-quobyte-912aa166-6b92-4aff-a217-2a2cf82c7833" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-quobyte-912aa166-6b92-4aff-a217-2a2cf82c7833" acquired by "delete_volume" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:51 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[81797110-056f-47fb-8bdf-e73039778387]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:31:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-912aa166-6b92-4aff-a217-2a2cf82c7833 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:51 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5df060d2-a00c-4127-8613-eec81ae6c716 1073741824" returned: 0 in 0.862s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5df060d2-a00c-4127-8613-eec81ae6c716 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:51 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5df060d2-a00c-4127-8613-eec81ae6c716 Jul 09 14:31:51 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:51 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-912aa166-6b92-4aff-a217-2a2cf82c7833 Jul 09 14:31:51 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:52 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-912aa166-6b92-4aff-a217-2a2cf82c7833" returned: 0 in 0.755s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-912aa166-6b92-4aff-a217-2a2cf82c7833 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:52 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5df060d2-a00c-4127-8613-eec81ae6c716" returned: 0 in 0.686s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.160s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1030677744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960cf65f81c04359a60d1034aee2b327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:44Z,use_quota=True,user_id='b988c002ba2049d392b2c762646a20d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Creating volume 31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:52 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-912aa166-6b92-4aff-a217-2a2cf82c7833 Jul 09 14:31:52 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:31:52 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:52 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1 1073741824 Jul 09 14:31:52 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dabc7d7e-01ad-4f0d-95e3-969e5bfbceb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df060d2-a00c-4127-8613-eec81ae6c716', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7c6dca-6f22-413f-befd-ac7f994591ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:52 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Volume volume-5df060d2-a00c-4127-8613-eec81ae6c716 (5df060d2-a00c-4127-8613-eec81ae6c716): created successfully Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7c6dca-6f22-413f-befd-ac7f994591ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Flow 'volume_create_manager' (e4604640-1596-4dbb-9dc7-39a606daf20c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:52 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-635e5a08-0a81-4caf-bb8d-65f86bc032f7 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Created volume successfully. Jul 09 14:31:52 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-912aa166-6b92-4aff-a217-2a2cf82c7833" returned: 0 in 0.698s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-quobyte-912aa166-6b92-4aff-a217-2a2cf82c7833" released by "delete_volume" :: held 1.505s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] Created reservations ['682c648d-665a-4e02-a201-697a2c1370a1', 'a1bb5020-3797-414f-afe5-42bac45c8802', '4df0369d-ae58-4a82-9992-97b63ae4646c', '11a06796-b102-407b-9d37-bdb783d36ee8'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:52 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:31:52 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:52 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1 1073741824" returned: 0 in 0.843s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:52 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1 Jul 09 14:31:52 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "cinder-ad8a62b4-8cc4-4f87-8a30-8229b526eeed-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-ad8a62b4-8cc4-4f87-8a30-8229b526eeed-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "cinder-quobyte-ad8a62b4-8cc4-4f87-8a30-8229b526eeed" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-quobyte-ad8a62b4-8cc4-4f87-8a30-8229b526eeed" acquired by "delete_volume" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ff49d3-0d9e-4b65-ab63-60d3f7276892]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ad8a62b4-8cc4-4f87-8a30-8229b526eeed {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:53 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.697s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:31:53 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] Deleted volume successfully. Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ed990bbd-2d74-4248-8906-aadb0407be56 tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-912aa166-6b92-4aff-a217-2a2cf82c7833-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:31:53 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1" returned: 0 in 0.708s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.431s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1298414893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21fa9892-b645-4ced-9d78-71022bb868c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960cf65f81c04359a60d1034aee2b327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:44Z,use_quota=True,user_id='b988c002ba2049d392b2c762646a20d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Creating volume 21fa9892-b645-4ced-9d78-71022bb868c1 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:31:53 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-21fa9892-b645-4ced-9d78-71022bb868c1 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:53 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ad8a62b4-8cc4-4f87-8a30-8229b526eeed Jul 09 14:31:53 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:53 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-21fa9892-b645-4ced-9d78-71022bb868c1 1073741824 Jul 09 14:31:53 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ce86e0-c26c-496f-b25c-4e0bfb2fe95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb19be3-81ca-48d3-a002-8dfce867ed3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:53 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Volume volume-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1 (31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1): created successfully Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb19be3-81ca-48d3-a002-8dfce867ed3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Flow 'volume_create_manager' (b6a09e0a-48ab-48cc-a762-84d3d1342a1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:53 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-3e541b19-4773-424b-a9a0-9867e050a575 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Created volume successfully. Jul 09 14:31:54 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ad8a62b4-8cc4-4f87-8a30-8229b526eeed" returned: 0 in 0.809s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ad8a62b4-8cc4-4f87-8a30-8229b526eeed {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:54 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ad8a62b4-8cc4-4f87-8a30-8229b526eeed Jul 09 14:31:54 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:54 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-21fa9892-b645-4ced-9d78-71022bb868c1 1073741824" returned: 0 in 0.951s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-21fa9892-b645-4ced-9d78-71022bb868c1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:54 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-21fa9892-b645-4ced-9d78-71022bb868c1 Jul 09 14:31:54 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:55 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ad8a62b4-8cc4-4f87-8a30-8229b526eeed" returned: 0 in 0.682s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-quobyte-ad8a62b4-8cc4-4f87-8a30-8229b526eeed" released by "delete_volume" :: held 1.553s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] Created reservations ['4a1de72b-a40a-451f-b7c2-1002924928cb', '40e56f05-e5dc-431c-a53d-eb600413afb5', '05617ab5-fde5-40f5-b843-b7fcf88b9285', 'ae5be6c0-cfb7-4af0-b39e-d3b24305ced1'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:55 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:31:55 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:55 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-21fa9892-b645-4ced-9d78-71022bb868c1" returned: 0 in 0.672s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.603s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1160490498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c38db3-dbf8-46fc-9eec-222f6c3736da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960cf65f81c04359a60d1034aee2b327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:45Z,use_quota=True,user_id='b988c002ba2049d392b2c762646a20d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Creating volume c6c38db3-dbf8-46fc-9eec-222f6c3736da {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:31:55 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c6c38db3-dbf8-46fc-9eec-222f6c3736da 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83b6140-3401-46c3-92a0-d8b9230d3ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21fa9892-b645-4ced-9d78-71022bb868c1', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:55 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c6c38db3-dbf8-46fc-9eec-222f6c3736da 1073741824 Jul 09 14:31:55 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (949107da-b971-4805-ae02-4a1d2e4eb96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:55 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Volume volume-21fa9892-b645-4ced-9d78-71022bb868c1 (21fa9892-b645-4ced-9d78-71022bb868c1): created successfully Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (949107da-b971-4805-ae02-4a1d2e4eb96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Flow 'volume_create_manager' (7aa47168-f540-48ca-8507-fef3d81ab274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:55 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-62ef868d-d51a-4d3d-92ae-82c0c77d0a4f tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Created volume successfully. Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "cinder-960e4d83-b860-48a7-825d-3b953ddf03a5-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-960e4d83-b860-48a7-825d-3b953ddf03a5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "cinder-quobyte-960e4d83-b860-48a7-825d-3b953ddf03a5" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-quobyte-960e4d83-b860-48a7-825d-3b953ddf03a5" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb71aa2-6ee1-4375-baf4-3daacd56bc59]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-960e4d83-b860-48a7-825d-3b953ddf03a5 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:55 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-960e4d83-b860-48a7-825d-3b953ddf03a5 Jul 09 14:31:55 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:55 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.739s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:31:55 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] Deleted volume successfully. Jul 09 14:31:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a2627e89-3804-4fbc-8307-925a0eb0529d tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-ad8a62b4-8cc4-4f87-8a30-8229b526eeed-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:31:56 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c6c38db3-dbf8-46fc-9eec-222f6c3736da 1073741824" returned: 0 in 0.896s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c6c38db3-dbf8-46fc-9eec-222f6c3736da {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:56 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c6c38db3-dbf8-46fc-9eec-222f6c3736da Jul 09 14:31:56 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:56 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-960e4d83-b860-48a7-825d-3b953ddf03a5" returned: 0 in 0.804s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-960e4d83-b860-48a7-825d-3b953ddf03a5 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:56 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-960e4d83-b860-48a7-825d-3b953ddf03a5 Jul 09 14:31:56 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:56 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c6c38db3-dbf8-46fc-9eec-222f6c3736da" returned: 0 in 0.664s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:31:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.790s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1091866627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b9b50ee-e7c4-42f6-aaad-ba56f286506b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960cf65f81c04359a60d1034aee2b327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:45Z,use_quota=True,user_id='b988c002ba2049d392b2c762646a20d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:31:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Creating volume 2b9b50ee-e7c4-42f6-aaad-ba56f286506b {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:31:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:31:56 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:31:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b9b50ee-e7c4-42f6-aaad-ba56f286506b 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:57 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b9b50ee-e7c4-42f6-aaad-ba56f286506b 1073741824 Jul 09 14:31:57 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0ea996-1730-460b-9942-d95943e6ef89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c38db3-dbf8-46fc-9eec-222f6c3736da', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1625f625-14e1-4285-aa37-3511d93435ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:57 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Volume volume-c6c38db3-dbf8-46fc-9eec-222f6c3736da (c6c38db3-dbf8-46fc-9eec-222f6c3736da): created successfully Jul 09 14:31:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1625f625-14e1-4285-aa37-3511d93435ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Flow 'volume_create_manager' (71a46b04-2584-486d-9df7-99981a99fbb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:57 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-8cf5b595-7cde-444c-9d35-089eb62b58b9 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Created volume successfully. Jul 09 14:31:57 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-960e4d83-b860-48a7-825d-3b953ddf03a5" returned: 0 in 0.692s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-quobyte-960e4d83-b860-48a7-825d-3b953ddf03a5" released by "delete_volume" :: held 1.555s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:31:57 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] Created reservations ['60ad34a6-95b1-4533-87b3-38e39de8d8f2', '3ada8a62-aa4e-480b-ab49-88759ef49606', '8b70c8ba-31fc-498b-ba77-1f4381df6553', '642b3c19-7c75-494a-9b08-bd97c7ff158a'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:31:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:57 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:31:57 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:57 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b9b50ee-e7c4-42f6-aaad-ba56f286506b 1073741824" returned: 0 in 0.876s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b9b50ee-e7c4-42f6-aaad-ba56f286506b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:57 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b9b50ee-e7c4-42f6-aaad-ba56f286506b Jul 09 14:31:57 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "cinder-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "cinder-quobyte-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-quobyte-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2" acquired by "delete_volume" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7cb64e-6a62-463e-9d68-c9071e1b3260]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:58 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.770s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:31:58 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] Deleted volume successfully. Jul 09 14:31:58 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2 Jul 09 14:31:58 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-c3dada0f-7174-4afb-b8eb-fc90ad25cedf tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-960e4d83-b860-48a7-825d-3b953ddf03a5-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:31:58 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b9b50ee-e7c4-42f6-aaad-ba56f286506b" returned: 0 in 0.722s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.166s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d076e22-b2dc-4f9c-8a0a-894587a6d59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2b026d06b2437fab679feb71276a43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:31:42Z,use_quota=True,user_id='c20131dd687f49c4bd92b4935c385965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a5e2ea5-086c-4f74-add4-40413f27eda8),volume_type_id=3a5e2ea5-086c-4f74-add4-40413f27eda8)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Creating volume 7d076e22-b2dc-4f9c-8a0a-894587a6d59f {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:31:58 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:58 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f 1073741824 Jul 09 14:31:58 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90417eb-3b46-4264-9449-64f580ca6eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b9b50ee-e7c4-42f6-aaad-ba56f286506b', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11848365-c94d-4544-9e6b-e5bc182c7fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:31:58 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Volume volume-2b9b50ee-e7c4-42f6-aaad-ba56f286506b (2b9b50ee-e7c4-42f6-aaad-ba56f286506b): created successfully Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11848365-c94d-4544-9e6b-e5bc182c7fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Flow 'volume_create_manager' (7505ec39-9411-40a8-a0e7-c9d3e5ee6c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:31:58 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9a06c951-e481-480f-9e44-ebf4178a7eb2 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Created volume successfully. Jul 09 14:31:58 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2" returned: 0 in 0.806s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:58 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2 Jul 09 14:31:58 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "cinder-2b9b50ee-e7c4-42f6-aaad-ba56f286506b-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-2b9b50ee-e7c4-42f6-aaad-ba56f286506b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "cinder-quobyte-2b9b50ee-e7c4-42f6-aaad-ba56f286506b" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:31:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-quobyte-2b9b50ee-e7c4-42f6-aaad-ba56f286506b" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:31:59 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f834e41-b448-4ca5-871f-797e5b453504]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:31:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b9b50ee-e7c4-42f6-aaad-ba56f286506b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:59 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b9b50ee-e7c4-42f6-aaad-ba56f286506b Jul 09 14:31:59 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:59 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f 1073741824" returned: 0 in 0.908s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:59 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f Jul 09 14:31:59 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:31:59 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Jul 09 14:31:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2" returned: 0 in 0.755s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:31:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-quobyte-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2" released by "delete_volume" :: held 1.625s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:31:59 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] Created reservations ['7bdacf2b-8c57-4bdf-81a1-39d252c363f4', '25fa66ea-85c0-4e0b-baf3-f50839672a62', '612712f6-6bd9-4f86-a7c2-dea9135f5941', '7ea082ce-9d8c-477b-b989-6b990c8a8533'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:31:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:31:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:31:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:31:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:31:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:31:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:31:59 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:31:59 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "cinder-2b53f912-4571-4c95-8c0b-40a21d3bcc6b-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-2b53f912-4571-4c95-8c0b-40a21d3bcc6b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:00 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b9b50ee-e7c4-42f6-aaad-ba56f286506b" returned: 0 in 0.918s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b9b50ee-e7c4-42f6-aaad-ba56f286506b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:00 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b9b50ee-e7c4-42f6-aaad-ba56f286506b Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "cinder-quobyte-2b53f912-4571-4c95-8c0b-40a21d3bcc6b" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:00 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-quobyte-2b53f912-4571-4c95-8c0b-40a21d3bcc6b" acquired by "delete_volume" :: waited 0.035s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:00 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f" returned: 0 in 0.804s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.272s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cd73d8-d938-4b58-b472-1923b14f803c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b53f912-4571-4c95-8c0b-40a21d3bcc6b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Creating offline snapshot 207e8711-a7f4-429a-8edb-d140915bdf65 of volume d5b6d363-d4f4-4d2b-8207-c78abc563fc2 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3a6429-f00c-4765-ae00-52deb10682a1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Attempting download of 90e9e03a-6462-4ab9-879f-feea7bc9a72e ((None, [{'url': 'file:///opt/stack/data/glance/images/90e9e03a-6462-4ab9-879f-feea7bc9a72e', 'metadata': {}}])) to volume 7d076e22-b2dc-4f9c-8a0a-894587a6d59f. {{(pid=87011) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 14:32:00 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.722s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc1ce11-582f-444d-a4cd-a17b6d6dc7ff]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90e9e03a-6462-4ab9-879f-feea7bc9a72e_3oci8e9d {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:00 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] Deleted volume successfully. Jul 09 14:32:00 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b53f912-4571-4c95-8c0b-40a21d3bcc6b Jul 09 14:32:00 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:00 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1ac758c1-b01d-4e27-8257-d918d6f0802d tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-dcf207f0-3588-4b33-9dfa-0e27e5bcdfa2-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:00 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2 Jul 09 14:32:00 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:00 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90e9e03a-6462-4ab9-879f-feea7bc9a72e_3oci8e9d Jul 09 14:32:00 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:01 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b9b50ee-e7c4-42f6-aaad-ba56f286506b" returned: 0 in 0.875s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-quobyte-2b9b50ee-e7c4-42f6-aaad-ba56f286506b" released by "delete_volume" :: held 1.838s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Created reservations ['0c1844d5-857b-48fe-81e7-8c55ab1eedb6', 'e55956f1-7f5f-4fc8-baf1-87f0c053bfa9', '2d5100bb-924e-4eb1-bf0e-303040e6d001', '92ae7862-ffdb-4510-9bed-8135479c3c51'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:01 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90e9e03a-6462-4ab9-879f-feea7bc9a72e_3oci8e9d" returned: 0 in 0.828s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90e9e03a-6462-4ab9-879f-feea7bc9a72e_3oci8e9d {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:01 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:01 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:01 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2" returned: 0 in 0.925s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:01 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b53f912-4571-4c95-8c0b-40a21d3bcc6b" returned: 0 in 0.996s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b53f912-4571-4c95-8c0b-40a21d3bcc6b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:01 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65 1G Jul 09 14:32:01 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:01 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b53f912-4571-4c95-8c0b-40a21d3bcc6b Jul 09 14:32:01 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:01 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90e9e03a-6462-4ab9-879f-feea7bc9a72e_3oci8e9d Jul 09 14:32:01 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "cinder-c6c38db3-dbf8-46fc-9eec-222f6c3736da-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-c6c38db3-dbf8-46fc-9eec-222f6c3736da-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "cinder-quobyte-c6c38db3-dbf8-46fc-9eec-222f6c3736da" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-quobyte-c6c38db3-dbf8-46fc-9eec-222f6c3736da" acquired by "delete_volume" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87bd898-297a-4ff7-94ac-61434ccf0749]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c6c38db3-dbf8-46fc-9eec-222f6c3736da {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:02 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c6c38db3-dbf8-46fc-9eec-222f6c3736da Jul 09 14:32:02 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:02 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-2b53f912-4571-4c95-8c0b-40a21d3bcc6b" returned: 0 in 0.946s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-quobyte-2b53f912-4571-4c95-8c0b-40a21d3bcc6b" released by "delete_volume" :: held 2.017s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:02 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:02 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90e9e03a-6462-4ab9-879f-feea7bc9a72e_3oci8e9d" returned: 1 in 1.033s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90e9e03a-6462-4ab9-879f-feea7bc9a72e_3oci8e9d' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.079s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f248e892-f78c-4178-808c-b7811131bcac]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:02 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Deleted volume successfully. Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b29e971c-f325-4290-9541-e3e5162c85bb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-2b9b50ee-e7c4-42f6-aaad-ba56f286506b-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] Created reservations ['826db349-ada4-45b3-bb94-8c09b72ebfd5', '5366a807-1c00-4e84-95b3-8f84d501a88e', '1afbfa72-4750-4168-97dd-6ad691dfa4c6', '073e2a9c-ce42-4b1b-9d75-0f2b3d6bd10d'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:02 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65 1G" returned: 0 in 1.224s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:02 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD Jul 09 14:32:02 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:02 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:02 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:02 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65 Jul 09 14:32:02 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:02 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c6c38db3-dbf8-46fc-9eec-222f6c3736da" returned: 0 in 1.139s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c6c38db3-dbf8-46fc-9eec-222f6c3736da {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:03 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c6c38db3-dbf8-46fc-9eec-222f6c3736da Jul 09 14:32:03 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:03 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD" returned: 0 in 0.903s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:03 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.849s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:03 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:03 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:03 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD Jul 09 14:32:03 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65" returned: 0 in 0.836s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:03 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65 is being set with open permissions: ugo+rw Jul 09 14:32:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:03 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] Deleted volume successfully. Jul 09 14:32:03 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65 Jul 09 14:32:03 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-17da60d8-59e2-4efe-90a2-d8e48cd3ffad tempest-CreateVolumesFromImageTest-528366832 None] Lock "cinder-2b53f912-4571-4c95-8c0b-40a21d3bcc6b-delete_volume" released by "delete_volume" :: held 3.273s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:03 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c6c38db3-dbf8-46fc-9eec-222f6c3736da" returned: 0 in 0.701s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-quobyte-c6c38db3-dbf8-46fc-9eec-222f6c3736da" released by "delete_volume" :: held 1.903s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:03 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Created reservations ['e4ed207f-f9b7-4377-8aeb-3af715e42d4c', '7448972d-7f57-4db5-8309-36ae335b5214', '3e8177c9-4d0b-42d2-9b4c-7869365d1c38', '9065d0d1-6490-44c3-b8fc-2437fa1ac064'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:03 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:03 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "cinder-21fa9892-b645-4ced-9d78-71022bb868c1-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-21fa9892-b645-4ced-9d78-71022bb868c1-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "cinder-quobyte-21fa9892-b645-4ced-9d78-71022bb868c1" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-quobyte-21fa9892-b645-4ced-9d78-71022bb868c1" acquired by "delete_volume" :: waited 0.031s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:04 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c479ac8-7000-4b00-a388-0ecf24d359f9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-21fa9892-b645-4ced-9d78-71022bb868c1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:04 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65" returned: 0 in 0.889s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:04 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:04 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-21fa9892-b645-4ced-9d78-71022bb868c1 Jul 09 14:32:04 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD" returned: 1 in 1.068s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:32:04 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] 90e9e03a-6462-4ab9-879f-feea7bc9a72e was raw, converting to raw {{(pid=87011) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 14:32:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:04 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.info Jul 09 14:32:04 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:04 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f Jul 09 14:32:04 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:04 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.977s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:04 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:04 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Deleted volume successfully. Jul 09 14:32:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-3ade89d8-21a2-4be9-bf1d-5761114a9dbc tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-c6c38db3-dbf8-46fc-9eec-222f6c3736da-delete_volume" released by "delete_volume" :: held 3.224s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:05 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.info" returned: 0 in 0.979s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:05 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.info is being set with open permissions: ugo+rw Jul 09 14:32:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:05 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.info Jul 09 14:32:05 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:05 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-21fa9892-b645-4ced-9d78-71022bb868c1" returned: 0 in 1.220s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-21fa9892-b645-4ced-9d78-71022bb868c1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:05 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-21fa9892-b645-4ced-9d78-71022bb868c1 Jul 09 14:32:05 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:05 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f" returned: 0 in 1.117s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:05 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90e9e03a-6462-4ab9-879f-feea7bc9a72e_iwj8psphdevstack@QuobyteHD, size 0.00 MB, duration 1.12 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:32:05 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 14:32:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:05 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f 1G Jul 09 14:32:05 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:06 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.info" returned: 0 in 0.787s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.798s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:06 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9fe9368c-1282-4a74-baf0-a798056b03eb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Create snapshot completed successfully Jul 09 14:32:06 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-21fa9892-b645-4ced-9d78-71022bb868c1" returned: 0 in 0.888s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:06 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-quobyte-21fa9892-b645-4ced-9d78-71022bb868c1" released by "delete_volume" :: held 2.175s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:06 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f 1G" returned: 0 in 0.896s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:06 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Created reservations ['71ea40f5-77cf-46e8-a872-870ca7f1ef00', '75a3705f-c28d-40c6-8723-dece76f9f049', '8a1cb13e-9dfd-41b0-8fb9-1e1531e24f51', '5fef283c-e897-49fc-af2f-64dff5d38671'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:06 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[96be5d5e-5d50-43b5-9b4b-d2b8c037c20d]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:06 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:06 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:06 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:06 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:06 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f Jul 09 14:32:06 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:07 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.773s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:07 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:07 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Deleted volume successfully. Jul 09 14:32:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a59eebe0-a8fc-4479-8016-06a7f768c8af tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-21fa9892-b645-4ced-9d78-71022bb868c1-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:07 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f" returned: 0 in 1.048s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "cinder-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "cinder-quobyte-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-quobyte-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1" acquired by "delete_volume" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:07 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f Jul 09 14:32:07 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:07 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dd0a81-b8f0-4803-bbda-90beb0273cd0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:07 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:32:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Flow 'volume_create_manager' (cef5270d-e594-496f-a4a1-054f0af9f1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3efec4-7164-4dd8-b1c4-c9330e58075f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3efec4-7164-4dd8-b1c4-c9330e58075f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-641190242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e1799ae-c7d6-43a3-b259-0886f1ccba85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eed8f2acd6a4274a728283c9d3c7370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:08Z,use_quota=True,user_id='bb30a73ed0414192b08205eb3ca6c2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e77cad7-50fc-43db-900a-1950451a7932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e77cad7-50fc-43db-900a-1950451a7932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97611bc6-ad6a-449b-9534-0082b772a07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97611bc6-ad6a-449b-9534-0082b772a07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e1799ae-c7d6-43a3-b259-0886f1ccba85', 'volume_name': 'volume-7e1799ae-c7d6-43a3-b259-0886f1ccba85', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de86e96-3ad3-4f80-bc38-2eb9948aa1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de86e96-3ad3-4f80-bc38-2eb9948aa1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93779618-0897-47c8-9373-0915b2a305e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:08 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Volume 7e1799ae-c7d6-43a3-b259-0886f1ccba85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e1799ae-c7d6-43a3-b259-0886f1ccba85', 'volume_size': 1} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-641190242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e1799ae-c7d6-43a3-b259-0886f1ccba85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eed8f2acd6a4274a728283c9d3c7370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:08Z,use_quota=True,user_id='bb30a73ed0414192b08205eb3ca6c2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Creating volume 7e1799ae-c7d6-43a3-b259-0886f1ccba85 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:08 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1 Jul 09 14:32:08 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:32:08 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7e1799ae-c7d6-43a3-b259-0886f1ccba85 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:08 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7e1799ae-c7d6-43a3-b259-0886f1ccba85 1073741824 Jul 09 14:32:08 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Flow 'volume_create_manager' (7b7b37ca-e600-4b92-9941-34aee83ce7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529bbf42-0e89-4773-bc36-c3d38f97f38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529bbf42-0e89-4773-bc36-c3d38f97f38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1407662738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3fb966-9135-42ba-8bdf-77e0145333d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eed8f2acd6a4274a728283c9d3c7370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:08Z,use_quota=True,user_id='bb30a73ed0414192b08205eb3ca6c2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1026fb2d-5d31-4d03-9f5e-687a1eb66691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1026fb2d-5d31-4d03-9f5e-687a1eb66691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb28f38a-3b0a-4b6d-9aa7-d8d122fdd456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb28f38a-3b0a-4b6d-9aa7-d8d122fdd456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d3fb966-9135-42ba-8bdf-77e0145333d4', 'volume_name': 'volume-6d3fb966-9135-42ba-8bdf-77e0145333d4', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613f99c3-3965-4939-82ec-e0aca9d28c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613f99c3-3965-4939-82ec-e0aca9d28c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a3c651-a527-44f7-ac6a-0d01523b9b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:08 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Volume 6d3fb966-9135-42ba-8bdf-77e0145333d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d3fb966-9135-42ba-8bdf-77e0145333d4', 'volume_size': 1} Jul 09 14:32:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:09 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1" returned: 0 in 1.173s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:09 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1 Jul 09 14:32:09 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:09 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f" returned: 1 in 1.606s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Downloaded image 90e9e03a-6462-4ab9-879f-feea7bc9a72e ((None, [{'url': 'file:///opt/stack/data/glance/images/90e9e03a-6462-4ab9-879f-feea7bc9a72e', 'metadata': {}}])) to volume 7d076e22-b2dc-4f9c-8a0a-894587a6d59f successfully. {{(pid=87011) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Temporary image 90e9e03a-6462-4ab9-879f-feea7bc9a72e for user c20131dd687f49c4bd92b4935c385965 is deleted. {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Marking volume 7d076e22-b2dc-4f9c-8a0a-894587a6d59f as bootable. {{(pid=87011) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Copying metadata from image 90e9e03a-6462-4ab9-879f-feea7bc9a72e to 7d076e22-b2dc-4f9c-8a0a-894587a6d59f. {{(pid=87011) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Creating volume glance metadata for volume 7d076e22-b2dc-4f9c-8a0a-894587a6d59f backed by image 90e9e03a-6462-4ab9-879f-feea7bc9a72e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '90e9e03a-6462-4ab9-879f-feea7bc9a72e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a4e54df7e02894e5551120ec4026d3c6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87011) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Flow 'volume_create_manager' (773eb7dd-ba5d-460e-9037-33a959ee4321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c537d3cc-c3fa-417b-a396-c69c3a0381f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c537d3cc-c3fa-417b-a396-c69c3a0381f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-794504398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045d5817-4392-4fa0-b240-90d39e485204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eed8f2acd6a4274a728283c9d3c7370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:09Z,use_quota=True,user_id='bb30a73ed0414192b08205eb3ca6c2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbad7e32-5723-4bcd-86ca-e52685293253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbad7e32-5723-4bcd-86ca-e52685293253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ef6b65-528b-486c-a1bf-8386c9d1ac34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ef6b65-528b-486c-a1bf-8386c9d1ac34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '045d5817-4392-4fa0-b240-90d39e485204', 'volume_name': 'volume-045d5817-4392-4fa0-b240-90d39e485204', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ec0ccc-5069-483c-b8f2-d75685c2ac09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ec0ccc-5069-483c-b8f2-d75685c2ac09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a544c9-2f4a-44bb-8ca9-35d302f40869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:09 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Volume 045d5817-4392-4fa0-b240-90d39e485204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-045d5817-4392-4fa0-b240-90d39e485204', 'volume_size': 1} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28427f8-4e5c-4fc8-b845-af189c97aa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f', 'volume_size': 1, 'image_id': '90e9e03a-6462-4ab9-879f-feea7bc9a72e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90e9e03a-6462-4ab9-879f-feea7bc9a72e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a4e54df7e02894e5551120ec4026d3c6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5d2b026d06b2437fab679feb71276a43', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '72376ea5b22b4afbbe0e887a615837c79c1762d89869b616bf60c66d80bd53d5ec60429629a4dca3c5f381ba7e5a8487d4a47ab9cbd4f585c27b16cae4cbbc05', 'id': '90e9e03a-6462-4ab9-879f-feea7bc9a72e', 'created_at': datetime.datetime(2026, 7, 9, 12, 31, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 31, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90e9e03a-6462-4ab9-879f-feea7bc9a72e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0da443-5585-4abf-bd0c-1e34fa1a9d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:09 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Volume volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f (7d076e22-b2dc-4f9c-8a0a-894587a6d59f): created successfully Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d0da443-5585-4abf-bd0c-1e34fa1a9d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Flow 'volume_create_manager' (8d01f545-23ed-4441-a179-3d4b8e32ef4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:09 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-1f7f6c84-1ddd-4745-889f-92404715155b tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Created volume successfully. Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:32:09 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Flow 'volume_create_manager' (437f7f0d-0c1d-4e12-be2e-e8bbb24005c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3698e113-2c31-4a74-8803-b31e8f6cb1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7e1799ae-c7d6-43a3-b259-0886f1ccba85 1073741824" returned: 0 in 1.595s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3698e113-2c31-4a74-8803-b31e8f6cb1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-413803090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90ea493-62d7-4d96-80f3-3010a0a1a181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eed8f2acd6a4274a728283c9d3c7370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:10Z,use_quota=True,user_id='bb30a73ed0414192b08205eb3ca6c2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0e9818-d107-4554-bd60-679d39e224ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0e9818-d107-4554-bd60-679d39e224ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428e9a22-3a17-4897-9024-2ce425b6adca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428e9a22-3a17-4897-9024-2ce425b6adca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a90ea493-62d7-4d96-80f3-3010a0a1a181', 'volume_name': 'volume-a90ea493-62d7-4d96-80f3-3010a0a1a181', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb795ca-0eca-4539-91ba-d4068eb87a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb795ca-0eca-4539-91ba-d4068eb87a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee382704-9c46-4e16-8068-af59c585f2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:09 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Volume a90ea493-62d7-4d96-80f3-3010a0a1a181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a90ea493-62d7-4d96-80f3-3010a0a1a181', 'volume_size': 1} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7e1799ae-c7d6-43a3-b259-0886f1ccba85 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:09 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7e1799ae-c7d6-43a3-b259-0886f1ccba85 Jul 09 14:32:09 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Acquiring lock "cinder-7d076e22-b2dc-4f9c-8a0a-894587a6d59f-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Lock "cinder-7d076e22-b2dc-4f9c-8a0a-894587a6d59f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:10 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1" returned: 0 in 1.169s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Acquiring lock "cinder-quobyte-7d076e22-b2dc-4f9c-8a0a-894587a6d59f" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-quobyte-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1" released by "delete_volume" :: held 2.454s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Lock "cinder-quobyte-7d076e22-b2dc-4f9c-8a0a-894587a6d59f" acquired by "delete_volume" :: waited 0.044s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[45798356-9a85-456b-8919-afa4773ab9a5]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Created reservations ['5f1e4300-f699-42ea-9607-e0782201a584', '671331a3-6e12-4b96-8ec1-17fdfdc8bb66', '4a9e7c6b-a438-4150-8f5c-fc23b28bfe2a', 'f67b4937-d4b8-4858-b62c-c82a8d70b806'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Flow 'volume_create_manager' (06eb5601-05ce-4d6c-8f99-7e06e727bc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e026bff2-f95f-444f-97c0-9586755c16d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:10 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f Jul 09 14:32:10 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e026bff2-f95f-444f-97c0-9586755c16d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-750241193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a9f4ef-4e82-45a6-aa31-96c233d80ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eed8f2acd6a4274a728283c9d3c7370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:10Z,use_quota=True,user_id='bb30a73ed0414192b08205eb3ca6c2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70642f63-4661-4e79-be1c-b9cb2218ee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70642f63-4661-4e79-be1c-b9cb2218ee72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6c78a8-a3fb-42f2-9cec-31e86c8441e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6c78a8-a3fb-42f2-9cec-31e86c8441e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5a9f4ef-4e82-45a6-aa31-96c233d80ce1', 'volume_name': 'volume-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2175b752-8493-4f5c-97c1-07e7bb851827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2175b752-8493-4f5c-97c1-07e7bb851827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9321ed84-8fcd-4c31-9274-50d7b98e1119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:10 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Volume d5a9f4ef-4e82-45a6-aa31-96c233d80ce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1', 'volume_size': 1} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:10 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:10 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:10 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7e1799ae-c7d6-43a3-b259-0886f1ccba85" returned: 0 in 1.003s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] <== create_volume: return (2713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.716s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.148s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1407662738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3fb966-9135-42ba-8bdf-77e0145333d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eed8f2acd6a4274a728283c9d3c7370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:08Z,use_quota=True,user_id='bb30a73ed0414192b08205eb3ca6c2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Creating volume 6d3fb966-9135-42ba-8bdf-77e0145333d4 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:32:10 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d3fb966-9135-42ba-8bdf-77e0145333d4 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:10 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d3fb966-9135-42ba-8bdf-77e0145333d4 1073741824 Jul 09 14:32:10 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93779618-0897-47c8-9373-0915b2a305e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e1799ae-c7d6-43a3-b259-0886f1ccba85', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7705883-4c3f-48ae-85c4-38059eb2b76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:10 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Volume volume-7e1799ae-c7d6-43a3-b259-0886f1ccba85 (7e1799ae-c7d6-43a3-b259-0886f1ccba85): created successfully Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7705883-4c3f-48ae-85c4-38059eb2b76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Flow 'volume_create_manager' (cef5270d-e594-496f-a4a1-054f0af9f1b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:10 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9e55a3fa-3e9c-4bd1-850d-e2d276e690e7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Created volume successfully. Jul 09 14:32:11 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "cinder-5df060d2-a00c-4127-8613-eec81ae6c716-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:11 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-5df060d2-a00c-4127-8613-eec81ae6c716-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:11 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "cinder-quobyte-5df060d2-a00c-4127-8613-eec81ae6c716" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:11 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-quobyte-5df060d2-a00c-4127-8613-eec81ae6c716" acquired by "delete_volume" :: waited 0.041s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:11 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[54210028-a72f-4764-9f62-61e375ee9535]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5df060d2-a00c-4127-8613-eec81ae6c716 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:11 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f" returned: 0 in 1.084s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:11 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f Jul 09 14:32:11 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:11 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5df060d2-a00c-4127-8613-eec81ae6c716 Jul 09 14:32:11 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:11 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.087s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:11 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:11 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Deleted volume successfully. Jul 09 14:32:11 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5859146e-988e-4607-9649-08f33e88826e tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-31ba9dbb-7e3e-4b5f-b56a-2b4bcbc9bcf1-delete_volume" released by "delete_volume" :: held 4.082s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:12 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d3fb966-9135-42ba-8bdf-77e0145333d4 1073741824" returned: 0 in 1.244s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d3fb966-9135-42ba-8bdf-77e0145333d4 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:12 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d3fb966-9135-42ba-8bdf-77e0145333d4 Jul 09 14:32:12 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:12 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f" returned: 1 in 0.993s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:32:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:12 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5df060d2-a00c-4127-8613-eec81ae6c716" returned: 0 in 1.108s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5df060d2-a00c-4127-8613-eec81ae6c716 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:12 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f Jul 09 14:32:12 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:12 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5df060d2-a00c-4127-8613-eec81ae6c716 Jul 09 14:32:12 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:32:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:12 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:12 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:13 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d3fb966-9135-42ba-8bdf-77e0145333d4" returned: 0 in 1.094s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] <== create_volume: return (2396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.399s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.864s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-794504398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045d5817-4392-4fa0-b240-90d39e485204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eed8f2acd6a4274a728283c9d3c7370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:09Z,use_quota=True,user_id='bb30a73ed0414192b08205eb3ca6c2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Creating volume 045d5817-4392-4fa0-b240-90d39e485204 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:32:13 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-045d5817-4392-4fa0-b240-90d39e485204 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:13 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-045d5817-4392-4fa0-b240-90d39e485204 1073741824 Jul 09 14:32:13 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:13 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7d076e22-b2dc-4f9c-8a0a-894587a6d59f" returned: 0 in 0.884s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Lock "cinder-quobyte-7d076e22-b2dc-4f9c-8a0a-894587a6d59f" released by "delete_volume" :: held 3.073s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:13 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.886s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:32:13 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-5df060d2-a00c-4127-8613-eec81ae6c716" returned: 0 in 1.020s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-quobyte-5df060d2-a00c-4127-8613-eec81ae6c716" released by "delete_volume" :: held 2.204s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:14 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-045d5817-4392-4fa0-b240-90d39e485204 1073741824" returned: 0 in 0.954s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a3c651-a527-44f7-ac6a-0d01523b9b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d3fb966-9135-42ba-8bdf-77e0145333d4', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166e6b75-5f71-4bb0-8ead-fd15d59fd984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:14 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Created reservations ['a961287d-9a43-49b2-bc7a-98935f6f0682', '540aa19c-dc75-4b9f-bed5-622e9c5291a4', '9be0d0f6-bb59-42f1-b814-eebc870a309e', '4660287b-639a-4891-a07b-366dbfd314b2'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:14 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Created reservations ['556f6a32-74df-4f24-a119-6a06e65127a3', '65d1fbf0-da8f-43fb-9820-c9b326ea3ac0', '8ce9300c-a336-46db-aef7-353c36045f00', 'e7e95370-d7cd-413e-9179-20814d544453'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:18 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Volume volume-6d3fb966-9135-42ba-8bdf-77e0145333d4 (6d3fb966-9135-42ba-8bdf-77e0145333d4): created successfully Jul 09 14:32:18 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166e6b75-5f71-4bb0-8ead-fd15d59fd984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:18 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Flow 'volume_create_manager' (7b7b37ca-e600-4b92-9941-34aee83ce7b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-045d5817-4392-4fa0-b240-90d39e485204 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:18 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-6c04f523-9e43-41c3-8565-8e255c3bc0bd tempest-CreateVolumesFromSnapshotTest-1829441460 None] Created volume successfully. Jul 09 14:32:18 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-045d5817-4392-4fa0-b240-90d39e485204 Jul 09 14:32:18 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:18 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:18 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:18 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:18 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:19 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-045d5817-4392-4fa0-b240-90d39e485204" returned: 0 in 0.790s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] <== create_volume: return (6279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 6.284s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.748s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-413803090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90ea493-62d7-4d96-80f3-3010a0a1a181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eed8f2acd6a4274a728283c9d3c7370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:10Z,use_quota=True,user_id='bb30a73ed0414192b08205eb3ca6c2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Creating volume a90ea493-62d7-4d96-80f3-3010a0a1a181 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:32:19 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a90ea493-62d7-4d96-80f3-3010a0a1a181 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a544c9-2f4a-44bb-8ca9-35d302f40869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045d5817-4392-4fa0-b240-90d39e485204', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:19 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a90ea493-62d7-4d96-80f3-3010a0a1a181 1073741824 Jul 09 14:32:19 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453bd6e5-971a-4b49-a2e9-7f3d5659fc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:19 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.786s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:19 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Deleted volume successfully. Jul 09 14:32:19 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Volume volume-045d5817-4392-4fa0-b240-90d39e485204 (045d5817-4392-4fa0-b240-90d39e485204): created successfully Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453bd6e5-971a-4b49-a2e9-7f3d5659fc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Flow 'volume_create_manager' (773eb7dd-ba5d-460e-9037-33a959ee4321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-77d550ff-e4fb-4576-b72b-d6d124440c11 tempest-VolumeAndVolumeTypeFromImageTest-1208112517 None] Lock "cinder-7d076e22-b2dc-4f9c-8a0a-894587a6d59f-delete_volume" released by "delete_volume" :: held 9.534s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:19 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9dbffc0d-87b0-4afb-8a07-dd805d68a24c tempest-CreateVolumesFromSnapshotTest-1829441460 None] Created volume successfully. Jul 09 14:32:19 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.852s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:19 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Deleted volume successfully. Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-9abef4fc-a940-4563-9ead-fbb16c9f0349 tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-5df060d2-a00c-4127-8613-eec81ae6c716-delete_volume" released by "delete_volume" :: held 8.593s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "cinder-c33f5c48-d372-493f-87c2-bd94d3bafc34-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-c33f5c48-d372-493f-87c2-bd94d3bafc34-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:20 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "cinder-quobyte-c33f5c48-d372-493f-87c2-bd94d3bafc34" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:20 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-quobyte-c33f5c48-d372-493f-87c2-bd94d3bafc34" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:20 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd70070-53f8-4e79-ac3b-47951ec9db45]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c33f5c48-d372-493f-87c2-bd94d3bafc34 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:20 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c33f5c48-d372-493f-87c2-bd94d3bafc34 Jul 09 14:32:20 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:20 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a90ea493-62d7-4d96-80f3-3010a0a1a181 1073741824" returned: 0 in 1.323s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a90ea493-62d7-4d96-80f3-3010a0a1a181 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:20 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a90ea493-62d7-4d96-80f3-3010a0a1a181 Jul 09 14:32:20 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:21 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c33f5c48-d372-493f-87c2-bd94d3bafc34" returned: 0 in 1.169s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c33f5c48-d372-493f-87c2-bd94d3bafc34 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:21 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c33f5c48-d372-493f-87c2-bd94d3bafc34 Jul 09 14:32:21 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:21 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a90ea493-62d7-4d96-80f3-3010a0a1a181" returned: 0 in 0.841s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] <== create_volume: return (2229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.238s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.218s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-750241193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a9f4ef-4e82-45a6-aa31-96c233d80ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eed8f2acd6a4274a728283c9d3c7370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:10Z,use_quota=True,user_id='bb30a73ed0414192b08205eb3ca6c2f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Creating volume d5a9f4ef-4e82-45a6-aa31-96c233d80ce1 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:32:21 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:21 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1 1073741824 Jul 09 14:32:21 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee382704-9c46-4e16-8068-af59c585f2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a90ea493-62d7-4d96-80f3-3010a0a1a181', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd869fc6-7f06-4276-8ae4-114178992f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:21 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Volume volume-a90ea493-62d7-4d96-80f3-3010a0a1a181 (a90ea493-62d7-4d96-80f3-3010a0a1a181): created successfully Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd869fc6-7f06-4276-8ae4-114178992f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:21 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Flow 'volume_create_manager' (437f7f0d-0c1d-4e12-be2e-e8bbb24005c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:21 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c5cfe80d-a135-4b7a-8fa1-1d6d74d7f2b5 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Created volume successfully. Jul 09 14:32:22 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c33f5c48-d372-493f-87c2-bd94d3bafc34" returned: 0 in 0.931s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-quobyte-c33f5c48-d372-493f-87c2-bd94d3bafc34" released by "delete_volume" :: held 2.180s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:22 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Created reservations ['aeecf531-e02b-4bc8-a6f6-bb711c15eaea', '91c6017c-0e35-4662-a8d0-7bb9a5ba9225', '7053cea4-7636-4546-8cdc-3f11d858444a', '6cd74313-67a5-490f-b6db-598185ca5ff7'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:22 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:22 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:22 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:22 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:23 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1 1073741824" returned: 0 in 1.226s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:23 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1 Jul 09 14:32:23 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:23 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.803s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:23 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:23 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Deleted volume successfully. Jul 09 14:32:23 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b719bc9c-c824-474e-b276-51b214ba47fb tempest-CreateVolumesFromSourceVolumeTest-525407914 None] Lock "cinder-c33f5c48-d372-493f-87c2-bd94d3bafc34-delete_volume" released by "delete_volume" :: held 3.295s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:23 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1" returned: 0 in 0.882s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] <== create_volume: return (2194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:32:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9321ed84-8fcd-4c31-9274-50d7b98e1119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:23 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b10c80-36d2-4c2f-918a-62eba33155ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:24 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Volume volume-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1 (d5a9f4ef-4e82-45a6-aa31-96c233d80ce1): created successfully Jul 09 14:32:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b10c80-36d2-4c2f-918a-62eba33155ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Flow 'volume_create_manager' (06eb5601-05ce-4d6c-8f99-7e06e727bc90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:24 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-2f3c7b78-5760-4d84-847a-00f3aff9bfe0 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Created volume successfully. Jul 09 14:32:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "cinder-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "cinder-quobyte-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-quobyte-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:24 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b61fcf6-3c47-43c0-8fbd-ef2741c9571d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:25 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1 Jul 09 14:32:25 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:25 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1" returned: 0 in 0.979s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:25 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1 Jul 09 14:32:25 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:25 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Flow 'volume_create_manager' (ddadf07f-d7ed-4c62-87c7-8546fcf361b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6864b78-548c-4b99-a0c2-c4c7a42eae5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6864b78-548c-4b99-a0c2-c4c7a42eae5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-159794464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea8c0ec0ce6416d84e454ebd327794f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:26Z,use_quota=True,user_id='024f37944382439bb0fb6c0a16d68931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d562d5bc-15e6-4e7d-9013-dc389e7e37ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d562d5bc-15e6-4e7d-9013-dc389e7e37ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e357542-cf68-46bf-a55b-fb28f3296a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e357542-cf68-46bf-a55b-fb28f3296a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57', 'volume_name': 'volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce5e166-302f-42a4-a297-fdcc82a5beaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce5e166-302f-42a4-a297-fdcc82a5beaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79210c75-28a3-42d3-a462-dd3d0d81a5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:26 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Volume 73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57', 'volume_size': 1} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-159794464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea8c0ec0ce6416d84e454ebd327794f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:26Z,use_quota=True,user_id='024f37944382439bb0fb6c0a16d68931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Creating volume 73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:32:26 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:26 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 1073741824 Jul 09 14:32:26 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:26 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1" returned: 0 in 0.747s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-quobyte-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1" released by "delete_volume" :: held 1.799s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] Created reservations ['1c7006e2-1ee3-475e-9585-b4f52c0b00e1', '7d454a67-ed25-4e28-b6f3-d7a0a9bec0f8', '3da8fe52-78e4-49bc-b8d0-a6bd9c656082', '9cf36f1e-2441-4ec3-94ce-d58adb42cdeb'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:26 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:26 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "cinder-a90ea493-62d7-4d96-80f3-3010a0a1a181-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-a90ea493-62d7-4d96-80f3-3010a0a1a181-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "cinder-quobyte-a90ea493-62d7-4d96-80f3-3010a0a1a181" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-quobyte-a90ea493-62d7-4d96-80f3-3010a0a1a181" acquired by "delete_volume" :: waited 0.029s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd40982-9b1d-45ac-81d2-a3c585209e62]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a90ea493-62d7-4d96-80f3-3010a0a1a181 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:27 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 1073741824" returned: 0 in 1.166s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:27 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 Jul 09 14:32:27 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:27 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a90ea493-62d7-4d96-80f3-3010a0a1a181 Jul 09 14:32:27 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:27 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Flow 'volume_create_manager' (081db605-72ec-4b88-985c-1424d21fee83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e65d11-501e-4ad7-bb66-10e75dbdc556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.888s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:27 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] Deleted volume successfully. Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e65d11-501e-4ad7-bb66-10e75dbdc556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e74989d3b3784df3a6e33acb09681d36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:28Z,use_quota=True,user_id='7eef7c2d885e421397c55f3dcc3a0393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe59f76-5970-452b-9bbc-3ae72e5ffba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe59f76-5970-452b-9bbc-3ae72e5ffba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0d7790-797c-4f8b-bd41-1a8c2e0978c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0d7790-797c-4f8b-bd41-1a8c2e0978c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b', 'volume_name': 'volume-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a03443a6-288e-459d-9409-f7e70cd0d1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a03443a6-288e-459d-9409-f7e70cd0d1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85b1da2-7b3d-4a99-951f-ef02ba09ca73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:27 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Volume 4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b', 'volume_size': 1} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a3b5a687-a28a-43e2-ba3a-c3399ebc37dc tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-d5a9f4ef-4e82-45a6-aa31-96c233d80ce1-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:28 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57" returned: 0 in 0.788s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.337s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e74989d3b3784df3a6e33acb09681d36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:28Z,use_quota=True,user_id='7eef7c2d885e421397c55f3dcc3a0393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Creating volume 4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:32:28 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79210c75-28a3-42d3-a462-dd3d0d81a5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:28 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b 1073741824 Jul 09 14:32:28 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106505d4-119d-48de-af07-ced61bd8c21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:28 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Volume volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 (73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57): created successfully Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (106505d4-119d-48de-af07-ced61bd8c21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Flow 'volume_create_manager' (ddadf07f-d7ed-4c62-87c7-8546fcf361b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:28 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c8a26237-d1d7-400f-aef3-d1b9082adeb2 tempest-VolumeDependencyTests-705041485 None] Created volume successfully. Jul 09 14:32:28 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a90ea493-62d7-4d96-80f3-3010a0a1a181" returned: 0 in 1.051s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a90ea493-62d7-4d96-80f3-3010a0a1a181 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:28 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a90ea493-62d7-4d96-80f3-3010a0a1a181 Jul 09 14:32:28 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Flow 'volume_create_manager' (361a0e61-9006-45ed-a62d-21c2068c8598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937067ed-b201-47a5-8b10-7b0d1f76abc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937067ed-b201-47a5-8b10-7b0d1f76abc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1054738073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24fd8589-e95f-410d-ba82-8d730357adec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17de080187542c0bc3c1003dd9fc9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:29Z,use_quota=True,user_id='7faca9f2f5c74fb4bbb56dc73c1765f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4362dc9d-8b9c-4cc7-8ed8-d7cedc0a3877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4362dc9d-8b9c-4cc7-8ed8-d7cedc0a3877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ce8a89-d488-4876-9d90-8a1c7ad8db8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ce8a89-d488-4876-9d90-8a1c7ad8db8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24fd8589-e95f-410d-ba82-8d730357adec', 'volume_name': 'volume-24fd8589-e95f-410d-ba82-8d730357adec', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba595e80-acd1-433e-beeb-77a3107ca806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba595e80-acd1-433e-beeb-77a3107ca806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80087bf9-c88c-401e-ac24-c6a5eeab6ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:28 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Volume 24fd8589-e95f-410d-ba82-8d730357adec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24fd8589-e95f-410d-ba82-8d730357adec', 'volume_size': 1} Jul 09 14:32:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:29 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a90ea493-62d7-4d96-80f3-3010a0a1a181" returned: 0 in 0.698s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:29 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b 1073741824" returned: 0 in 0.872s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-quobyte-a90ea493-62d7-4d96-80f3-3010a0a1a181" released by "delete_volume" :: held 1.808s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:29 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b Jul 09 14:32:29 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Created reservations ['1a6b1f6e-88f9-4e5d-bac0-16618acecac1', 'cbca3224-94a1-4bcd-9260-f230b99a36b2', '413c7d1a-2a85-45cf-aae6-4da5dd97cc1b', 'd4215eca-fbdd-4494-853c-ac04b5fa6fa9'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:29 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:29 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "cinder-045d5817-4392-4fa0-b240-90d39e485204-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-045d5817-4392-4fa0-b240-90d39e485204-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "cinder-quobyte-045d5817-4392-4fa0-b240-90d39e485204" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-quobyte-045d5817-4392-4fa0-b240-90d39e485204" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d2035d-f5ca-4e47-9670-60f54c77f130]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-045d5817-4392-4fa0-b240-90d39e485204 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:29 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-045d5817-4392-4fa0-b240-90d39e485204 Jul 09 14:32:29 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:29 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b" returned: 0 in 0.744s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.016s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1054738073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24fd8589-e95f-410d-ba82-8d730357adec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17de080187542c0bc3c1003dd9fc9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:29Z,use_quota=True,user_id='7faca9f2f5c74fb4bbb56dc73c1765f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Creating volume 24fd8589-e95f-410d-ba82-8d730357adec {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:32:29 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-24fd8589-e95f-410d-ba82-8d730357adec 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:29 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-24fd8589-e95f-410d-ba82-8d730357adec 1073741824 Jul 09 14:32:29 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85b1da2-7b3d-4a99-951f-ef02ba09ca73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf9864d-022f-43e2-806d-865d742a4e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:29 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Volume volume-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b (4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b): created successfully Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf9864d-022f-43e2-806d-865d742a4e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Flow 'volume_create_manager' (081db605-72ec-4b88-985c-1424d21fee83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:29 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b0b232b7-d31d-4a3e-919d-765151c02030 tempest-CinderUnicodeTest-1763726389 None] Created volume successfully. Jul 09 14:32:29 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.779s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:29 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:29 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Deleted volume successfully. Jul 09 14:32:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-78ad7cca-bd83-4756-8216-7ef1ecd0f891 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-a90ea493-62d7-4d96-80f3-3010a0a1a181-delete_volume" released by "delete_volume" :: held 2.865s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:30 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-045d5817-4392-4fa0-b240-90d39e485204" returned: 0 in 0.879s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-045d5817-4392-4fa0-b240-90d39e485204 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:30 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-045d5817-4392-4fa0-b240-90d39e485204 Jul 09 14:32:30 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:30 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-24fd8589-e95f-410d-ba82-8d730357adec 1073741824" returned: 0 in 0.876s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-24fd8589-e95f-410d-ba82-8d730357adec {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:30 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-24fd8589-e95f-410d-ba82-8d730357adec Jul 09 14:32:30 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:31 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-045d5817-4392-4fa0-b240-90d39e485204" returned: 0 in 0.708s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-quobyte-045d5817-4392-4fa0-b240-90d39e485204" released by "delete_volume" :: held 1.641s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Created reservations ['f2f8840f-b531-4722-b90e-b169d62e7f04', '1fc53cbe-95f0-43ed-92cb-efc3e7fec40a', '497cbeda-d202-4304-a1d3-bddb039dc16b', '7897a8c9-6074-4c63-af24-bdb49b1261ff'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:31 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:31 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Flow 'volume_create_manager' (e50bc056-5ea9-4c5b-b765-989fcf57cb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6484cb-3a9f-4acd-9285-e96daa57723e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6484cb-3a9f-4acd-9285-e96daa57723e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-195827421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78967e6-a943-40f4-8c82-3d80743b660a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e74989d3b3784df3a6e33acb09681d36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:31Z,use_quota=True,user_id='7eef7c2d885e421397c55f3dcc3a0393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caef58cf-e87b-4c97-bace-922c137110dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caef58cf-e87b-4c97-bace-922c137110dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ce1ec6-a880-4c17-a945-49855e4bb28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ce1ec6-a880-4c17-a945-49855e4bb28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c78967e6-a943-40f4-8c82-3d80743b660a', 'volume_name': 'volume-c78967e6-a943-40f4-8c82-3d80743b660a', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caa68916-ca85-42ab-a793-2b27f6a93cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caa68916-ca85-42ab-a793-2b27f6a93cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48adb015-aeb3-4ca7-89b7-09e0d85b4416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:31 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Volume c78967e6-a943-40f4-8c82-3d80743b660a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c78967e6-a943-40f4-8c82-3d80743b660a', 'volume_size': 1} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:31 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-24fd8589-e95f-410d-ba82-8d730357adec" returned: 0 in 0.699s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.145s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80087bf9-c88c-401e-ac24-c6a5eeab6ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24fd8589-e95f-410d-ba82-8d730357adec', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbec53c-0266-4786-91e9-ec36ab0c1e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] Creating offline snapshot 012c4a61-f186-4daa-9616-ec0e68c44949 of volume 73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:32:31 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Volume volume-24fd8589-e95f-410d-ba82-8d730357adec (24fd8589-e95f-410d-ba82-8d730357adec): created successfully Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbbec53c-0266-4786-91e9-ec36ab0c1e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Flow 'volume_create_manager' (361a0e61-9006-45ed-a62d-21c2068c8598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5836a3-56c3-431d-b6d1-3d8fea30413e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:31 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-1043c84b-5edd-4442-b110-0071f8e9e0cb tempest-ProjectReaderTests-1907246205 None] Created volume successfully. Jul 09 14:32:31 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 Jul 09 14:32:31 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "cinder-6d3fb966-9135-42ba-8bdf-77e0145333d4-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-6d3fb966-9135-42ba-8bdf-77e0145333d4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=192,cinder:SELECT=124,cinder:DELETE=17,cinder:INSERT=46 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "cinder-quobyte-6d3fb966-9135-42ba-8bdf-77e0145333d4" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-quobyte-6d3fb966-9135-42ba-8bdf-77e0145333d4" acquired by "delete_volume" :: waited 0.034s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f54c44-1c55-4f76-a259-d0f71c0be7d9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d3fb966-9135-42ba-8bdf-77e0145333d4 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:31 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d3fb966-9135-42ba-8bdf-77e0145333d4 Jul 09 14:32:31 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:31 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.695s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:31 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:31 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Deleted volume successfully. Jul 09 14:32:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-675ff81f-dfb5-471f-8214-ba5034f48ca7 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-045d5817-4392-4fa0-b240-90d39e485204-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] Acquiring lock "cinder-24fd8589-e95f-410d-ba82-8d730357adec-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] Lock "cinder-24fd8589-e95f-410d-ba82-8d730357adec-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] Acquiring lock "cinder-quobyte-24fd8589-e95f-410d-ba82-8d730357adec" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:32 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] Lock "cinder-quobyte-24fd8589-e95f-410d-ba82-8d730357adec" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:32 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f52daee-be35-46e0-82c7-9638466967ac]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-24fd8589-e95f-410d-ba82-8d730357adec {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:32 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-24fd8589-e95f-410d-ba82-8d730357adec Jul 09 14:32:32 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:32 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57" returned: 0 in 0.949s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:32 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949 1G Jul 09 14:32:32 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:32 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d3fb966-9135-42ba-8bdf-77e0145333d4" returned: 0 in 0.834s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d3fb966-9135-42ba-8bdf-77e0145333d4 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:32 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d3fb966-9135-42ba-8bdf-77e0145333d4 Jul 09 14:32:32 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:33 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-24fd8589-e95f-410d-ba82-8d730357adec" returned: 0 in 0.850s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-24fd8589-e95f-410d-ba82-8d730357adec {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:33 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-24fd8589-e95f-410d-ba82-8d730357adec Jul 09 14:32:33 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:33 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949 1G" returned: 0 in 0.882s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:33 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d3fb966-9135-42ba-8bdf-77e0145333d4" returned: 0 in 0.705s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:33 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949 Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-quobyte-6d3fb966-9135-42ba-8bdf-77e0145333d4" released by "delete_volume" :: held 1.587s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:33 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=137,cinder:UPDATE=184,cinder:INSERT=46,cinder:DELETE=19 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Created reservations ['27b071d6-3c01-4851-81dd-c18f42df2c4b', 'e66ef9b9-1227-48c4-87fd-417d5d8f9f4c', '250b066f-bd17-4cbf-bb47-5598d054dcc1', '0f1c0da7-416f-47cd-8c6c-f996c5c3a25f'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:33 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:33 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:33 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-24fd8589-e95f-410d-ba82-8d730357adec" returned: 0 in 0.712s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] Lock "cinder-quobyte-24fd8589-e95f-410d-ba82-8d730357adec" released by "delete_volume" :: held 1.611s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] Created reservations ['35ff0e64-1a88-432a-806d-3aee310a68f0', 'f7baeab5-48be-4085-8109-83c0f4cf3a30', '295e5de3-5a37-4ade-ab03-2f9be31e3f7b', '35cb7398-39e0-4a12-b402-8f2e5e1b0608'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "cinder-7e1799ae-c7d6-43a3-b259-0886f1ccba85-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-7e1799ae-c7d6-43a3-b259-0886f1ccba85-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:33 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:33 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "cinder-quobyte-7e1799ae-c7d6-43a3-b259-0886f1ccba85" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-quobyte-7e1799ae-c7d6-43a3-b259-0886f1ccba85" acquired by "delete_volume" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:34 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[143c489b-3739-432a-a341-39eee7044acd]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7e1799ae-c7d6-43a3-b259-0886f1ccba85 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:34 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949" returned: 0 in 0.828s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:34 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949 is being set with open permissions: ugo+rw Jul 09 14:32:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:34 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7e1799ae-c7d6-43a3-b259-0886f1ccba85 Jul 09 14:32:34 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:34 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949 Jul 09 14:32:34 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:34 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.841s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:34 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:34 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Deleted volume successfully. Jul 09 14:32:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0bb5742a-d811-4a76-a2b5-fa54f5dd30fb tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-6d3fb966-9135-42ba-8bdf-77e0145333d4-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:34 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.836s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:34 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:34 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] Deleted volume successfully. Jul 09 14:32:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0be07df7-29d2-4759-a6cf-c02e34e884d7 tempest-ProjectReaderTests-1907246205 None] Lock "cinder-24fd8589-e95f-410d-ba82-8d730357adec-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:34 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:32:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Flow 'volume_create_manager' (ba87a70f-d454-4815-ab39-b0d83e8fa8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af773650-204a-4349-afc8-585ba48952b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af773650-204a-4349-afc8-585ba48952b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093024195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c2fe40-e47d-4950-a067-ac1269082d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17de080187542c0bc3c1003dd9fc9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:35Z,use_quota=True,user_id='7faca9f2f5c74fb4bbb56dc73c1765f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:35 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4eb323e-543f-454a-9462-04861b3112c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4eb323e-543f-454a-9462-04861b3112c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32e97b0-677a-42ba-a6ae-1f8d3b55d5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32e97b0-677a-42ba-a6ae-1f8d3b55d5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4c2fe40-e47d-4950-a067-ac1269082d65', 'volume_name': 'volume-a4c2fe40-e47d-4950-a067-ac1269082d65', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e431c00e-78d0-4e41-a149-1dd278775cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e431c00e-78d0-4e41-a149-1dd278775cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:35 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb2b3f35-8173-46a7-a607-bc9964b535a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:35 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Volume a4c2fe40-e47d-4950-a067-ac1269082d65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4c2fe40-e47d-4950-a067-ac1269082d65', 'volume_size': 1} Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7e1799ae-c7d6-43a3-b259-0886f1ccba85" returned: 0 in 0.972s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949" returned: 0 in 0.870s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7e1799ae-c7d6-43a3-b259-0886f1ccba85 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:35 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7e1799ae-c7d6-43a3-b259-0886f1ccba85 Jul 09 14:32:35 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:35 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.info Jul 09 14:32:35 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:35 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-7e1799ae-c7d6-43a3-b259-0886f1ccba85" returned: 0 in 0.643s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-quobyte-7e1799ae-c7d6-43a3-b259-0886f1ccba85" released by "delete_volume" :: held 1.653s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:35 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.info" returned: 0 in 0.658s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:35 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.info is being set with open permissions: ugo+rw Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Created reservations ['79f7dc61-f51c-4a41-8db3-846355698d3a', '126805cc-1627-4137-b79b-81cc67c7f1a2', 'e1cd0811-1da3-4058-bb26-4c839520cebe', 'ca08d759-9eab-4884-bce6-7e55b71a724a'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:35 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.info Jul 09 14:32:35 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:35 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:35 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "cinder-207e8711-a7f4-429a-8edb-d140915bdf65-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-207e8711-a7f4-429a-8edb-d140915bdf65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "cinder-quobyte-d5b6d363-d4f4-4d2b-8207-c78abc563fc2" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-quobyte-d5b6d363-d4f4-4d2b-8207-c78abc563fc2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "cinder-quobyte-207e8711-a7f4-429a-8edb-d140915bdf65" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-quobyte-207e8711-a7f4-429a-8edb-d140915bdf65" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Deleting offline snapshot 207e8711-a7f4-429a-8edb-d140915bdf65 of volume d5b6d363-d4f4-4d2b-8207-c78abc563fc2 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] snapshot_file for this snap is: volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[719f30af-f761-4032-83d0-b89a4ed4ef4e]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:36 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65 Jul 09 14:32:36 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:36 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.info" returned: 0 in 0.692s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.056s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-195827421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78967e6-a943-40f4-8c82-3d80743b660a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e74989d3b3784df3a6e33acb09681d36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:31Z,use_quota=True,user_id='7eef7c2d885e421397c55f3dcc3a0393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Creating volume c78967e6-a943-40f4-8c82-3d80743b660a {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:32:36 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:36 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a 1073741824 Jul 09 14:32:36 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:36 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.678s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:36 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-62686325-f4e9-4c6e-8679-ef351f742c3c tempest-VolumeDependencyTests-705041485 None] Create snapshot completed successfully Jul 09 14:32:36 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Deleted volume successfully. Jul 09 14:32:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-936f9c27-912a-4117-8454-cc4965a92e28 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-7e1799ae-c7d6-43a3-b259-0886f1ccba85-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:37 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65" returned: 0 in 0.848s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9864e32-45f6-4b21-aff6-b305f772e591]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:37 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2 Jul 09 14:32:37 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Flow 'volume_create_manager' (4202da7b-51e7-4a11-87cc-736a4fa48219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59fdb566-76cc-4a32-8067-ea7b028222a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59fdb566-76cc-4a32-8067-ea7b028222a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1396722815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4c7154-7e20-4189-9722-f0b8e12e73ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea8c0ec0ce6416d84e454ebd327794f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=012c4a61-f186-4daa-9616-ec0e68c44949,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:37Z,use_quota=True,user_id='024f37944382439bb0fb6c0a16d68931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07646307-9cb8-46f9-9870-ca076488fe7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07646307-9cb8-46f9-9870-ca076488fe7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aefbf62-5f18-4165-bc3f-0a47356aa9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aefbf62-5f18-4165-bc3f-0a47356aa9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6c4c7154-7e20-4189-9722-f0b8e12e73ee', 'volume_name': 'volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee', 'volume_size': 1, 'snapshot_id': '012c4a61-f186-4daa-9616-ec0e68c44949'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cbc4aa-3d57-4ea0-b60a-bcdb7c2ec970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cbc4aa-3d57-4ea0-b60a-bcdb7c2ec970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c54e279-138d-4476-a978-5a8738edd074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:37 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Volume 6c4c7154-7e20-4189-9722-f0b8e12e73ee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee', 'volume_size': 1, 'snapshot_id': '012c4a61-f186-4daa-9616-ec0e68c44949'} Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:37 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a 1073741824" returned: 0 in 0.958s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:37 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a Jul 09 14:32:37 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:37 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2" returned: 0 in 0.798s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:37 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65 Jul 09 14:32:37 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:38 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a" returned: 0 in 0.694s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.130s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093024195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c2fe40-e47d-4950-a067-ac1269082d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17de080187542c0bc3c1003dd9fc9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:35Z,use_quota=True,user_id='7faca9f2f5c74fb4bbb56dc73c1765f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Creating volume a4c2fe40-e47d-4950-a067-ac1269082d65 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:32:38 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a4c2fe40-e47d-4950-a067-ac1269082d65 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:38 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a4c2fe40-e47d-4950-a067-ac1269082d65 1073741824 Jul 09 14:32:38 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48adb015-aeb3-4ca7-89b7-09e0d85b4416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c78967e6-a943-40f4-8c82-3d80743b660a', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a33bb91-b548-41d4-9acd-2e9bccc0a709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:38 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Volume volume-c78967e6-a943-40f4-8c82-3d80743b660a (c78967e6-a943-40f4-8c82-3d80743b660a): created successfully Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a33bb91-b548-41d4-9acd-2e9bccc0a709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Flow 'volume_create_manager' (e50bc056-5ea9-4c5b-b765-989fcf57cb36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:38 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b02e1642-c28f-4085-a8f9-7399303a68a7 tempest-CinderUnicodeTest-1763726389 None] Created volume successfully. Jul 09 14:32:38 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65" returned: 0 in 0.759s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:38 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65 Jul 09 14:32:38 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:39 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a4c2fe40-e47d-4950-a067-ac1269082d65 1073741824" returned: 0 in 0.904s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a4c2fe40-e47d-4950-a067-ac1269082d65 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:39 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a4c2fe40-e47d-4950-a067-ac1269082d65 Jul 09 14:32:39 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:39 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2.207e8711-a7f4-429a-8edb-d140915bdf65" returned: 0 in 0.728s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-quobyte-207e8711-a7f4-429a-8edb-d140915bdf65" released by "_delete_snapshot" :: held 3.246s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-quobyte-d5b6d363-d4f4-4d2b-8207-c78abc563fc2" released by "delete_snapshot" :: held 3.270s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Created reservations ['793f931c-8abd-4e43-837d-40cfdf7ff000', '96e505c9-b71a-4609-9d82-a4325d88ea40', 'ddaaecd2-0d9c-4ec2-adb0-a04b9a11c162', '1f92ebfa-f8e5-4893-b2fd-6ac518c7de7a'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:39 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Delete snapshot completed successfully. Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-36588462-0000-4038-bb97-8b34f41f1738 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-207e8711-a7f4-429a-8edb-d140915bdf65-delete_snapshot" released by "delete_snapshot" :: held 3.436s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:39 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a4c2fe40-e47d-4950-a067-ac1269082d65" returned: 0 in 0.651s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.395s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Acquiring lock "cinder-quobyte-012c4a61-f186-4daa-9616-ec0e68c44949-6c4c7154-7e20-4189-9722-f0b8e12e73ee" by "_create_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb2b3f35-8173-46a7-a607-bc9964b535a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4c2fe40-e47d-4950-a067-ac1269082d65', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff5414e-4723-4f24-804c-a61c697475e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Lock "cinder-quobyte-012c4a61-f186-4daa-9616-ec0e68c44949-6c4c7154-7e20-4189-9722-f0b8e12e73ee" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Creating volume 6c4c7154-7e20-4189-9722-f0b8e12e73ee from snapshot 012c4a61-f186-4daa-9616-ec0e68c44949 {{(pid=87011) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Acquiring lock "cinder-quobyte-6c4c7154-7e20-4189-9722-f0b8e12e73ee" by "_copy_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:39 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Volume volume-a4c2fe40-e47d-4950-a067-ac1269082d65 (a4c2fe40-e47d-4950-a067-ac1269082d65): created successfully Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff5414e-4723-4f24-804c-a61c697475e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Flow 'volume_create_manager' (ba87a70f-d454-4815-ab39-b0d83e8fa8c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Lock "cinder-quobyte-6c4c7154-7e20-4189-9722-f0b8e12e73ee" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] snapshot: 012c4a61-f186-4daa-9616-ec0e68c44949, volume: 6c4c7154-7e20-4189-9722-f0b8e12e73ee, {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:39 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-75c7f28a-460d-40c1-a786-6fdc25bbd02b tempest-ProjectReaderTests-1907246205 None] Created volume successfully. Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af614c8-e64d-4ac6-a73f-334b3f69984a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:40 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949 Jul 09 14:32:40 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] Acquiring lock "cinder-a4c2fe40-e47d-4950-a067-ac1269082d65-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] Lock "cinder-a4c2fe40-e47d-4950-a067-ac1269082d65-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] Acquiring lock "cinder-quobyte-a4c2fe40-e47d-4950-a067-ac1269082d65" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] Lock "cinder-quobyte-a4c2fe40-e47d-4950-a067-ac1269082d65" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "cinder-d5b6d363-d4f4-4d2b-8207-c78abc563fc2-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:40 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5650b657-264f-40f8-86f8-3c79c5c8f3b4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a4c2fe40-e47d-4950-a067-ac1269082d65 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-d5b6d363-d4f4-4d2b-8207-c78abc563fc2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "cinder-quobyte-d5b6d363-d4f4-4d2b-8207-c78abc563fc2" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-quobyte-d5b6d363-d4f4-4d2b-8207-c78abc563fc2" acquired by "delete_volume" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:40 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a4c2fe40-e47d-4950-a067-ac1269082d65 Jul 09 14:32:40 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:40 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e19328-9a52-479d-b0ba-2c21a27ad429]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:40 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2 Jul 09 14:32:40 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:40 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949" returned: 0 in 0.860s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:32:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 14:32:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Creating direct copy from snapshot {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 14:32:40 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[a265ed41-da8d-403a-89d4-09ed7906a3d2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:40 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 Jul 09 14:32:40 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:41 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a4c2fe40-e47d-4950-a067-ac1269082d65" returned: 0 in 0.804s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a4c2fe40-e47d-4950-a067-ac1269082d65 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:41 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a4c2fe40-e47d-4950-a067-ac1269082d65 Jul 09 14:32:41 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:41 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2" returned: 0 in 0.800s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:41 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2 Jul 09 14:32:41 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:41 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57" returned: 0 in 0.841s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:41 devstack cinder-volume[87011]: DEBUG cinder.utils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Path /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee not found in is_blk_device check {{(pid=87011) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 14:32:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:41 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee Jul 09 14:32:41 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:41 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a4c2fe40-e47d-4950-a067-ac1269082d65" returned: 0 in 0.710s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:42 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] Lock "cinder-quobyte-a4c2fe40-e47d-4950-a067-ac1269082d65" released by "delete_volume" :: held 1.564s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:42 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] Created reservations ['2f9fda21-d081-4b6e-a464-a5770eb60d30', '7b887418-ef11-4e07-9669-a2bb1161ce50', 'f97a1ad8-d1fd-4268-bd4c-494181ae536c', '50e9d87d-a84e-47de-894d-77422e99158b'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:42 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:42 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:42 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d5b6d363-d4f4-4d2b-8207-c78abc563fc2" returned: 0 in 0.783s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:42 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-quobyte-d5b6d363-d4f4-4d2b-8207-c78abc563fc2" released by "delete_volume" :: held 1.662s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:42 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Created reservations ['00dbd066-b2ad-4f71-bf2c-4a8b75fd66bb', 'cd6b8581-78df-485c-aae1-a6992a13a3f0', '4aec6db6-a32a-4b00-b8e6-af86e7a74006', 'de1ce52f-70fc-421c-91f8-7557332746b4'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:42 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:42 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:43 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.382s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:43 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:43 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] Deleted volume successfully. Jul 09 14:32:43 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-59e2e4ee-3d18-4ed5-affc-f1ad39391ebd tempest-ProjectReaderTests-1907246205 None] Lock "cinder-a4c2fe40-e47d-4950-a067-ac1269082d65-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:43 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:43 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:32:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Flow 'volume_create_manager' (a89327ce-466d-49d5-95df-a3665bb116aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:43 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9248e55b-fa4a-427f-af7d-5ba31f9f21e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.614s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:43 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:43 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Deleted volume successfully. Jul 09 14:32:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9248e55b-fa4a-427f-af7d-5ba31f9f21e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-979586265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8170af7-421c-4efc-b351-fadf0ec431e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17de080187542c0bc3c1003dd9fc9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:44Z,use_quota=True,user_id='7faca9f2f5c74fb4bbb56dc73c1765f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1600f60-c6c4-4dd5-9580-201b4f764a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1600f60-c6c4-4dd5-9580-201b4f764a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b367c61b-3dae-4261-a583-c48a75f88618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b367c61b-3dae-4261-a583-c48a75f88618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8170af7-421c-4efc-b351-fadf0ec431e1', 'volume_name': 'volume-a8170af7-421c-4efc-b351-fadf0ec431e1', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7568966a-cd83-4a8c-b370-bbfecf56073b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7568966a-cd83-4a8c-b370-bbfecf56073b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:44 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830f13a9-a174-49ef-91bb-e8d14699c1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:44 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Volume a8170af7-421c-4efc-b351-fadf0ec431e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8170af7-421c-4efc-b351-fadf0ec431e1', 'volume_size': 1} Jul 09 14:32:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:44 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-eaae6a76-e734-4535-8d83-29ce50f4de98 tempest-CreateVolumesFromSnapshotTest-1829441460 None] Lock "cinder-d5b6d363-d4f4-4d2b-8207-c78abc563fc2-delete_volume" released by "delete_volume" :: held 3.625s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:47 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee" returned: 0 in 5.827s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:47 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf275d3-d61c-43a0-94f0-4a64c2d362d4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:47 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 Jul 09 14:32:47 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:48 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57" returned: 0 in 0.907s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:48 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:32:48 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Converted 1024.00 MB image at 175.70 MB/s Jul 09 14:32:48 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee is being set with open permissions: ugo+rw Jul 09 14:32:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:48 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee Jul 09 14:32:48 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:49 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee" returned: 0 in 0.661s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Lock "cinder-quobyte-6c4c7154-7e20-4189-9722-f0b8e12e73ee" released by "_copy_volume_from_snapshot" :: held 9.200s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Lock "cinder-quobyte-012c4a61-f186-4daa-9616-ec0e68c44949-6c4c7154-7e20-4189-9722-f0b8e12e73ee" released by "_create_volume_from_snapshot" :: held 9.249s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.282s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.967s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] Creating offline snapshot 0f1572e6-b4ce-48c2-9508-b3286a8dd8a4 of volume c78967e6-a943-40f4-8c82-3d80743b660a {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c54e279-138d-4476-a978-5a8738edd074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee', 'volume_size': 1, 'snapshot_id': '012c4a61-f186-4daa-9616-ec0e68c44949'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bfda4a3-654e-4eb1-aaa1-84381efdd2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bc4833-41f6-44b7-8168-5dbeb34ef755]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:49 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Volume volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee (6c4c7154-7e20-4189-9722-f0b8e12e73ee): created successfully Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bfda4a3-654e-4eb1-aaa1-84381efdd2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Flow 'volume_create_manager' (4202da7b-51e7-4a11-87cc-736a4fa48219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:49 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-836bbd33-a445-421b-b8d1-adcda5035880 tempest-VolumeDependencyTests-705041485 None] Created volume successfully. Jul 09 14:32:49 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a Jul 09 14:32:49 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] Acquiring lock "cinder-012c4a61-f186-4daa-9616-ec0e68c44949-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] Lock "cinder-012c4a61-f186-4daa-9616-ec0e68c44949-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] Acquiring lock "cinder-quobyte-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] Lock "cinder-quobyte-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] Acquiring lock "cinder-quobyte-012c4a61-f186-4daa-9616-ec0e68c44949" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] Lock "cinder-quobyte-012c4a61-f186-4daa-9616-ec0e68c44949" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] Deleting offline snapshot 012c4a61-f186-4daa-9616-ec0e68c44949 of volume 73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] snapshot_file for this snap is: volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5bce2a-ea72-4560-a239-b04df0adea7f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:49 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949 Jul 09 14:32:49 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:50 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a" returned: 0 in 0.928s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:50 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4 1G Jul 09 14:32:50 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:50 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949" returned: 0 in 0.815s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:32:50 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[496322ae-ae53-4ff2-831b-04c84a6c7fea]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:50 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 Jul 09 14:32:50 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:50 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4 1G" returned: 0 in 0.932s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78967e6-a943-40f4-8c82-3d80743b660a -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:51 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78967e6-a943-40f4-8c82-3d80743b660a -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4 Jul 09 14:32:51 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:51 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Flow 'volume_create_manager' (e35bca95-d96d-4a01-83c1-f36bdb9a2e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5307bf3-c31e-4701-ab1d-a381981e84f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57" returned: 0 in 0.887s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5307bf3-c31e-4701-ab1d-a381981e84f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066c9b2b-f589-43ed-828a-a0febad5bbfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f30201ea1234cb1a7ad9c088fbc70dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:51Z,use_quota=True,user_id='eb61a1018be24694ba9bc4025276c04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0f9295-66ed-4b87-a0b4-3868bf9defc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:51 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949 Jul 09 14:32:51 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0f9295-66ed-4b87-a0b4-3868bf9defc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3d2952-3444-4c31-b822-38eeb88fb3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG cinder.image.glance [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Creating Keystone auth plugin from conf {{(pid=87011) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3d2952-3444-4c31-b822-38eeb88fb3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '066c9b2b-f589-43ed-828a-a0febad5bbfd', 'volume_name': 'volume-066c9b2b-f589-43ed-828a-a0febad5bbfd', 'volume_size': 1, 'image_id': '672f3925-05d6-493c-8e40-573d457d2a12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/672f3925-05d6-493c-8e40-573d457d2a12', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f873e8a9fe49badc3e4e706827e5340d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f30201ea1234cb1a7ad9c088fbc70dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bfe01a1a4140b7af6f0cf780ef71ddb050b7ff023d0be227f8a70dfede57a89ab12d5eb9eb9248b8ead30d3d2d96ca0dff2dc6a6fd34722b3d464f3b29b2e891', 'id': '672f3925-05d6-493c-8e40-573d457d2a12', 'created_at': datetime.datetime(2026, 7, 9, 12, 32, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 32, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/672f3925-05d6-493c-8e40-573d457d2a12/file', 'properties': {}}, 'image_service': }' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7ea241-d410-4cff-bb03-8bcd0890b886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab7ea241-d410-4cff-bb03-8bcd0890b886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dab1e2f-5110-41a2-b037-adbe79f0ab64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:51 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Volume 066c9b2b-f589-43ed-828a-a0febad5bbfd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-066c9b2b-f589-43ed-828a-a0febad5bbfd', 'volume_size': 1, 'image_id': '672f3925-05d6-493c-8e40-573d457d2a12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/672f3925-05d6-493c-8e40-573d457d2a12', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f873e8a9fe49badc3e4e706827e5340d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f30201ea1234cb1a7ad9c088fbc70dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bfe01a1a4140b7af6f0cf780ef71ddb050b7ff023d0be227f8a70dfede57a89ab12d5eb9eb9248b8ead30d3d2d96ca0dff2dc6a6fd34722b3d464f3b29b2e891', 'id': '672f3925-05d6-493c-8e40-573d457d2a12', 'created_at': datetime.datetime(2026, 7, 9, 12, 32, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 32, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/672f3925-05d6-493c-8e40-573d457d2a12/file', 'properties': {}}, 'image_service': } Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Trying to clone 066c9b2b-f589-43ed-828a-a0febad5bbfd from image 672f3925-05d6-493c-8e40-573d457d2a12 at location (None, [{'url': 'file:///opt/stack/data/glance/images/672f3925-05d6-493c-8e40-573d457d2a12', 'metadata': {}}]). {{(pid=87011) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 14:32:51 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Image download 0.00 MB at 0.00 MB/s Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[94655142-16ef-410e-878a-ded458ab24e7]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:51 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78967e6-a943-40f4-8c82-3d80743b660a -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4" returned: 0 in 0.740s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:51 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4 is being set with open permissions: ugo+rw Jul 09 14:32:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:51 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD Jul 09 14:32:51 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:51 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4 Jul 09 14:32:51 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:52 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949" returned: 0 in 0.807s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:52 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949 Jul 09 14:32:52 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:52 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD" returned: 0 in 0.745s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:52 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4" returned: 0 in 0.646s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:52 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.info Jul 09 14:32:52 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:52 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD Jul 09 14:32:52 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:52 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57.012c4a61-f186-4daa-9616-ec0e68c44949" returned: 0 in 0.685s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] Lock "cinder-quobyte-012c4a61-f186-4daa-9616-ec0e68c44949" released by "_delete_snapshot" :: held 3.304s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] Lock "cinder-quobyte-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57" released by "delete_snapshot" :: held 3.333s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:52 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] Created reservations ['fa0fb9dd-bb30-4935-bf77-b0785a186a07', '8e1286e4-25db-4eb5-b087-8ab1ac604eff', '67a9252a-edae-49ba-9d9e-8800e59fcec5', '60285bf1-52f2-457e-a11d-051fec3a311e'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:52 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] Delete snapshot completed successfully. Jul 09 14:32:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-0e93def1-fb20-4bf2-8179-b3c3dcc83180 tempest-VolumeDependencyTests-705041485 None] Lock "cinder-012c4a61-f186-4daa-9616-ec0e68c44949-delete_snapshot" released by "delete_snapshot" :: held 3.485s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:53 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.info" returned: 0 in 0.671s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:53 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.info is being set with open permissions: ugo+rw Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:53 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.info Jul 09 14:32:53 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:53 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD" returned: 1 in 0.761s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Temporary image 672f3925-05d6-493c-8e40-573d457d2a12 is fetched for user eb61a1018be24694ba9bc4025276c04f. {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fdf326-b769-40ff-940b-64acf0f7aedb]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:53 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD Jul 09 14:32:53 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] Acquiring lock "cinder-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] Lock "cinder-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] Acquiring lock "cinder-quobyte-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] Lock "cinder-quobyte-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57" acquired by "delete_volume" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:53 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.info" returned: 0 in 0.726s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.761s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[746dac2a-5670-4d8d-acf0-4ed772590c44]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.756s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-979586265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8170af7-421c-4efc-b351-fadf0ec431e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17de080187542c0bc3c1003dd9fc9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:44Z,use_quota=True,user_id='7faca9f2f5c74fb4bbb56dc73c1765f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Creating volume a8170af7-421c-4efc-b351-fadf0ec431e1 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:32:53 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a8170af7-421c-4efc-b351-fadf0ec431e1 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:53 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a8170af7-421c-4efc-b351-fadf0ec431e1 1073741824 Jul 09 14:32:53 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:53 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-64c1a1b0-8ec6-4e37-8112-c5abca7a7be3 tempest-CinderUnicodeTest-1763726389 None] Create snapshot completed successfully Jul 09 14:32:53 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD" returned: 0 in 0.772s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:53 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 Jul 09 14:32:53 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:54 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD Jul 09 14:32:54 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:54 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57" returned: 0 in 0.827s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:54 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a8170af7-421c-4efc-b351-fadf0ec431e1 1073741824" returned: 0 in 0.861s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:54 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57 Jul 09 14:32:54 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:54 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD" returned: 1 in 0.764s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:32:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a8170af7-421c-4efc-b351-fadf0ec431e1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:54 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a8170af7-421c-4efc-b351-fadf0ec431e1 Jul 09 14:32:54 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] Acquiring lock "cinder-0f1572e6-b4ce-48c2-9508-b3286a8dd8a4-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] Lock "cinder-0f1572e6-b4ce-48c2-9508-b3286a8dd8a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] Acquiring lock "cinder-quobyte-c78967e6-a943-40f4-8c82-3d80743b660a" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] Lock "cinder-quobyte-c78967e6-a943-40f4-8c82-3d80743b660a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] Acquiring lock "cinder-quobyte-0f1572e6-b4ce-48c2-9508-b3286a8dd8a4" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] Lock "cinder-quobyte-0f1572e6-b4ce-48c2-9508-b3286a8dd8a4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] Deleting offline snapshot 0f1572e6-b4ce-48c2-9508-b3286a8dd8a4 of volume c78967e6-a943-40f4-8c82-3d80743b660a {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] snapshot_file for this snap is: volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[27982bd1-16d9-4310-8c57-10bb5ab6aaf6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:55 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4 Jul 09 14:32:55 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:55 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57" returned: 0 in 0.677s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] Lock "cinder-quobyte-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57" released by "delete_volume" :: held 1.609s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:55 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a8170af7-421c-4efc-b351-fadf0ec431e1" returned: 0 in 0.667s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.688s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066c9b2b-f589-43ed-828a-a0febad5bbfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f30201ea1234cb1a7ad9c088fbc70dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:51Z,use_quota=True,user_id='eb61a1018be24694ba9bc4025276c04f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Creating volume 066c9b2b-f589-43ed-828a-a0febad5bbfd {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:32:55 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] Created reservations ['2ff20637-2ed3-4f09-a770-7cabd18162f8', '79b47a66-38c1-4783-86db-80c1235e528d', '05e05fea-90b2-4f00-8cc7-4a8a37c14b03', 'bf23e80b-09e2-4332-8d11-a29c08b68518'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:55 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd 1073741824 Jul 09 14:32:55 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830f13a9-a174-49ef-91bb-e8d14699c1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8170af7-421c-4efc-b351-fadf0ec431e1', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff55fa4d-5808-49d4-a905-c56ce42f2afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:55 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Volume volume-a8170af7-421c-4efc-b351-fadf0ec431e1 (a8170af7-421c-4efc-b351-fadf0ec431e1): created successfully Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff55fa4d-5808-49d4-a905-c56ce42f2afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Flow 'volume_create_manager' (a89327ce-466d-49d5-95df-a3665bb116aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:55 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-17a04be3-5892-4455-963f-94cd53aa16c6 tempest-ProjectReaderTests-1907246205 None] Created volume successfully. Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:55 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:55 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:55 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4" returned: 0 in 0.772s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c78967e6-a943-40f4-8c82-3d80743b660a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adcf21a-4d00-434a-a334-5b3815342fff]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] Acquiring lock "cinder-a8170af7-421c-4efc-b351-fadf0ec431e1-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] Acquiring lock "cinder-6c4c7154-7e20-4189-9722-f0b8e12e73ee-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] Lock "cinder-a8170af7-421c-4efc-b351-fadf0ec431e1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] Lock "cinder-6c4c7154-7e20-4189-9722-f0b8e12e73ee-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:56 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a Jul 09 14:32:56 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] Acquiring lock "cinder-quobyte-a8170af7-421c-4efc-b351-fadf0ec431e1" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] Lock "cinder-quobyte-a8170af7-421c-4efc-b351-fadf0ec431e1" acquired by "delete_volume" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] Acquiring lock "cinder-quobyte-6c4c7154-7e20-4189-9722-f0b8e12e73ee" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c78a3ce-445d-4a01-b5af-d18bae145639]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a8170af7-421c-4efc-b351-fadf0ec431e1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] Lock "cinder-quobyte-6c4c7154-7e20-4189-9722-f0b8e12e73ee" acquired by "delete_volume" :: waited 0.037s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea11a8a0-c2cc-4cdd-a903-0c0a77647777]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:56 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.712s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:56 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] Deleted volume successfully. Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-46a1d5e9-93e1-4c0d-90e7-3f025ef89172 tempest-VolumeDependencyTests-705041485 None] Lock "cinder-73c3ef8e-bff1-4f8b-8762-ccb6bf2daf57-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:56 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a8170af7-421c-4efc-b351-fadf0ec431e1 Jul 09 14:32:56 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:56 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee Jul 09 14:32:56 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:56 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd 1073741824" returned: 0 in 1.020s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:56 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd Jul 09 14:32:56 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:56 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a" returned: 0 in 0.961s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:56 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4 Jul 09 14:32:56 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:57 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a8170af7-421c-4efc-b351-fadf0ec431e1" returned: 0 in 0.906s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a8170af7-421c-4efc-b351-fadf0ec431e1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:57 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a8170af7-421c-4efc-b351-fadf0ec431e1 Jul 09 14:32:57 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:57 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd" returned: 0 in 0.758s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:32:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:57 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:57 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Attempting download of 672f3925-05d6-493c-8e40-573d457d2a12 ((None, [{'url': 'file:///opt/stack/data/glance/images/672f3925-05d6-493c-8e40-573d457d2a12', 'metadata': {}}])) to volume 066c9b2b-f589-43ed-828a-a0febad5bbfd. {{(pid=87011) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 14:32:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee" returned: 0 in 1.035s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:57 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee Jul 09 14:32:57 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:57 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[91277c91-7333-4226-bc41-7b1b96d014bc]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_672f3925-05d6-493c-8e40-573d457d2a12_62kv_jen {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:57 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_672f3925-05d6-493c-8e40-573d457d2a12_62kv_jen Jul 09 14:32:57 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:57 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4" returned: 0 in 0.782s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:57 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4 Jul 09 14:32:57 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:57 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-a8170af7-421c-4efc-b351-fadf0ec431e1" returned: 0 in 0.803s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:57 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] Lock "cinder-quobyte-a8170af7-421c-4efc-b351-fadf0ec431e1" released by "delete_volume" :: held 1.767s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:57 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] Created reservations ['e18968a0-24d4-4d3a-91ea-67c54c5530b8', 'd2758d30-573a-45f0-91d2-34ab3492daf4', 'ea5951ae-2f0e-4849-881a-185cc9034738', 'df5067cf-1982-4e0a-92cd-727b6d613236'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:58 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6c4c7154-7e20-4189-9722-f0b8e12e73ee" returned: 0 in 0.771s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] Lock "cinder-quobyte-6c4c7154-7e20-4189-9722-f0b8e12e73ee" released by "delete_volume" :: held 1.876s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:58 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:58 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:58 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_672f3925-05d6-493c-8e40-573d457d2a12_62kv_jen" returned: 0 in 0.796s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_672f3925-05d6-493c-8e40-573d457d2a12_62kv_jen {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] Created reservations ['23e48334-0b1f-4f05-89c4-7f0e6144638f', 'dc96de99-3cf9-4a15-aea0-9238666417dc', 'd69c9487-3810-4ad6-861b-79c25d62c2ea', '2a0d05b6-a828-4767-87a2-ce170a596443'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:58 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_672f3925-05d6-493c-8e40-573d457d2a12_62kv_jen Jul 09 14:32:58 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:58 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:32:58 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:58 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a.0f1572e6-b4ce-48c2-9508-b3286a8dd8a4" returned: 0 in 0.856s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] Lock "cinder-quobyte-0f1572e6-b4ce-48c2-9508-b3286a8dd8a4" released by "_delete_snapshot" :: held 3.568s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] Lock "cinder-quobyte-c78967e6-a943-40f4-8c82-3d80743b660a" released by "delete_snapshot" :: held 3.604s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] Created reservations ['018eaeca-7c66-4731-8840-7c92df6a7046', 'eafe7785-f91b-4d59-b72b-6777fd388235', '4d663207-0caf-457d-bad5-f5528806dec0', '31bb408b-f27e-4880-bf16-2172ba0f2117'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:32:58 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] Delete snapshot completed successfully. Jul 09 14:32:58 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-355047e1-de3a-457e-8743-50267cad4e1f tempest-CinderUnicodeTest-1763726389 None] Lock "cinder-0f1572e6-b4ce-48c2-9508-b3286a8dd8a4-delete_snapshot" released by "delete_snapshot" :: held 4.014s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Flow 'volume_create_manager' (842ea580-c5e7-496e-ae39-9a8b90c8588e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09455662-0233-4410-9984-4f9e2aa91cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:59 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09455662-0233-4410-9984-4f9e2aa91cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-539467040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c0ac44-0b28-4be6-a87f-5aca77e68762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17de080187542c0bc3c1003dd9fc9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:59Z,use_quota=True,user_id='7faca9f2f5c74fb4bbb56dc73c1765f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e560d078-e8bb-465e-97dc-05d6e6a4aaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e560d078-e8bb-465e-97dc-05d6e6a4aaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:59 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f1bf7e-219e-45e2-8fbe-0e7af9e272bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f1bf7e-219e-45e2-8fbe-0e7af9e272bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54c0ac44-0b28-4be6-a87f-5aca77e68762', 'volume_name': 'volume-54c0ac44-0b28-4be6-a87f-5aca77e68762', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f3735cc-1d54-4dd9-864d-233f4cfb27a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f3735cc-1d54-4dd9-864d-233f4cfb27a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cda638-b538-4461-b969-0bdf92915170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:32:59 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Volume 54c0ac44-0b28-4be6-a87f-5aca77e68762: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54c0ac44-0b28-4be6-a87f-5aca77e68762', 'volume_size': 1} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-539467040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54c0ac44-0b28-4be6-a87f-5aca77e68762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17de080187542c0bc3c1003dd9fc9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:32:59Z,use_quota=True,user_id='7faca9f2f5c74fb4bbb56dc73c1765f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Creating volume 54c0ac44-0b28-4be6-a87f-5aca77e68762 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:32:59 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54c0ac44-0b28-4be6-a87f-5aca77e68762 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] Acquiring lock "cinder-c78967e6-a943-40f4-8c82-3d80743b660a-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.341s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_672f3925-05d6-493c-8e40-573d457d2a12_62kv_jen" returned: 1 in 1.278s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_672f3925-05d6-493c-8e40-573d457d2a12_62kv_jen' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:59 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54c0ac44-0b28-4be6-a87f-5aca77e68762 1073741824 Jul 09 14:32:59 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d3d533-91de-48de-ab1c-958588d3e61d]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:59 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] Deleted volume successfully. Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:59 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] Lock "cinder-c78967e6-a943-40f4-8c82-3d80743b660a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.130s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:32:59 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] Deleted volume successfully. Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-247697dc-f937-4593-bbfb-df4e91e827c1 tempest-ProjectReaderTests-1907246205 None] Lock "cinder-a8170af7-421c-4efc-b351-fadf0ec431e1-delete_volume" released by "delete_volume" :: held 3.493s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-08ceac94-25f7-4b89-968f-39de9e3cea5f tempest-VolumeDependencyTests-705041485 None] Lock "cinder-6c4c7154-7e20-4189-9722-f0b8e12e73ee-delete_volume" released by "delete_volume" :: held 3.485s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] Acquiring lock "cinder-quobyte-c78967e6-a943-40f4-8c82-3d80743b660a" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] Lock "cinder-quobyte-c78967e6-a943-40f4-8c82-3d80743b660a" acquired by "delete_volume" :: waited 0.026s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:32:59 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD Jul 09 14:32:59 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[d987a74a-f310-439f-8fd5-4473a4c30077]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:32:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:32:59 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a Jul 09 14:32:59 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:00 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD" returned: 0 in 0.966s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:00 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54c0ac44-0b28-4be6-a87f-5aca77e68762 1073741824" returned: 0 in 1.069s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54c0ac44-0b28-4be6-a87f-5aca77e68762 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:00 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54c0ac44-0b28-4be6-a87f-5aca77e68762 Jul 09 14:33:00 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:00 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD Jul 09 14:33:00 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:00 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a" returned: 0 in 0.984s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:00 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a Jul 09 14:33:00 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:01 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54c0ac44-0b28-4be6-a87f-5aca77e68762" returned: 0 in 0.783s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:01 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD" returned: 1 in 0.886s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] 672f3925-05d6-493c-8e40-573d457d2a12 was raw, converting to raw {{(pid=87011) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cda638-b538-4461-b969-0bdf92915170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54c0ac44-0b28-4be6-a87f-5aca77e68762', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:01 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24799e12-9571-477a-b924-fd4f95fbcab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:01 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:01 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Volume volume-54c0ac44-0b28-4be6-a87f-5aca77e68762 (54c0ac44-0b28-4be6-a87f-5aca77e68762): created successfully Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24799e12-9571-477a-b924-fd4f95fbcab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Flow 'volume_create_manager' (842ea580-c5e7-496e-ae39-9a8b90c8588e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:33:01 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-6d92bb2f-1dcc-44e2-8e00-e2aa35981056 tempest-ProjectReaderTests-1907246205 None] Created volume successfully. Jul 09 14:33:01 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c78967e6-a943-40f4-8c82-3d80743b660a" returned: 0 in 0.758s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] Lock "cinder-quobyte-c78967e6-a943-40f4-8c82-3d80743b660a" released by "delete_volume" :: held 1.843s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] Created reservations ['57eeaeea-bd45-4859-8a00-956eaa41e2ad', '1e3dfa96-cecf-4465-b11d-a210b2d634af', '52d29aa4-bb5f-46bb-ac65-8c0c2ea72af6', 'e5c82d4c-c720-45ec-a465-0b4f124c5fe3'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:01 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:33:01 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] Acquiring lock "cinder-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] Lock "cinder-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] Acquiring lock "cinder-quobyte-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] Lock "cinder-quobyte-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b" acquired by "delete_volume" :: waited 0.028s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b59f7c9-1070-44fb-baec-450441a363cd]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:02 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b Jul 09 14:33:02 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:02 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd" returned: 0 in 0.880s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:02 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_672f3925-05d6-493c-8e40-573d457d2a12_a0flvpxedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:33:02 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 14:33:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:02 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd 1G Jul 09 14:33:02 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:02 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.823s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:02 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:33:02 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] Deleted volume successfully. Jul 09 14:33:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-6489eb60-bec4-48dd-b3fe-e6eeb3065052 tempest-CinderUnicodeTest-1763726389 None] Lock "cinder-c78967e6-a943-40f4-8c82-3d80743b660a-delete_volume" released by "delete_volume" :: held 2.985s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] Acquiring lock "cinder-54c0ac44-0b28-4be6-a87f-5aca77e68762-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] Lock "cinder-54c0ac44-0b28-4be6-a87f-5aca77e68762-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] Acquiring lock "cinder-quobyte-54c0ac44-0b28-4be6-a87f-5aca77e68762" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] Lock "cinder-quobyte-54c0ac44-0b28-4be6-a87f-5aca77e68762" acquired by "delete_volume" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:02 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eab36a-1971-4618-a56a-745ca3839041]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54c0ac44-0b28-4be6-a87f-5aca77e68762 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:02 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54c0ac44-0b28-4be6-a87f-5aca77e68762 Jul 09 14:33:02 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:02 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b" returned: 0 in 1.096s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:02 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b Jul 09 14:33:02 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:03 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd 1G" returned: 0 in 0.938s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:03 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[e870bfa8-c524-408c-bab4-74b884d51284]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:03 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd Jul 09 14:33:03 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:03 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54c0ac44-0b28-4be6-a87f-5aca77e68762" returned: 0 in 0.866s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54c0ac44-0b28-4be6-a87f-5aca77e68762 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:03 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54c0ac44-0b28-4be6-a87f-5aca77e68762 Jul 09 14:33:03 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:03 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b" returned: 0 in 0.772s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] Lock "cinder-quobyte-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b" released by "delete_volume" :: held 1.931s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:03 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] Created reservations ['53dd71f3-f36c-4f77-ac6d-2cc755cf10b1', '84f70000-c8b0-4d2c-b020-658284ae7f09', '411612e4-2475-4f2c-b3f6-0ef22dc8e703', 'e463313e-1945-4c72-926e-ee354afabd45'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:33:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:33:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:33:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:03 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:33:03 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:04 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd" returned: 0 in 0.973s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:04 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:04 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd Jul 09 14:33:04 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-54c0ac44-0b28-4be6-a87f-5aca77e68762" returned: 0 in 0.812s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] Lock "cinder-quobyte-54c0ac44-0b28-4be6-a87f-5aca77e68762" released by "delete_volume" :: held 1.741s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:04 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] Created reservations ['81fc0f93-2f15-4ee9-a7e3-dd71e4880cf4', 'a6edd00d-22ea-4dd0-a7a1-97e34e5f955a', 'fd7ebb80-3fe3-4039-80b5-c13e715fdf03', '0f0f256d-2f31-4080-9910-b5d456ece8bb'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:33:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:33:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:33:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:04 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:33:04 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:04 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.882s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:04 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:33:04 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] Deleted volume successfully. Jul 09 14:33:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-132fd459-e998-4e12-aba7-1c94d0e3e572 tempest-CinderUnicodeTest-1763726389 None] Lock "cinder-4e1d4cbf-e0af-4c1b-a1da-88a4e642ad2b-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:05 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd" returned: 1 in 0.955s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:33:05 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Downloaded image 672f3925-05d6-493c-8e40-573d457d2a12 ((None, [{'url': 'file:///opt/stack/data/glance/images/672f3925-05d6-493c-8e40-573d457d2a12', 'metadata': {}}])) to volume 066c9b2b-f589-43ed-828a-a0febad5bbfd successfully. {{(pid=87011) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 14:33:05 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Temporary image 672f3925-05d6-493c-8e40-573d457d2a12 for user eb61a1018be24694ba9bc4025276c04f is deleted. {{(pid=87011) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 14:33:05 devstack cinder-volume[87011]: DEBUG cinder.volume.volume_utils [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Marking volume 066c9b2b-f589-43ed-828a-a0febad5bbfd as bootable. {{(pid=87011) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 14:33:05 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Copying metadata from image 672f3925-05d6-493c-8e40-573d457d2a12 to 066c9b2b-f589-43ed-828a-a0febad5bbfd. {{(pid=87011) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 14:33:05 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Creating volume glance metadata for volume 066c9b2b-f589-43ed-828a-a0febad5bbfd backed by image 672f3925-05d6-493c-8e40-573d457d2a12 with: {'image_id': '672f3925-05d6-493c-8e40-573d457d2a12', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f873e8a9fe49badc3e4e706827e5340d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87011) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 14:33:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dab1e2f-5110-41a2-b037-adbe79f0ab64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-066c9b2b-f589-43ed-828a-a0febad5bbfd', 'volume_size': 1, 'image_id': '672f3925-05d6-493c-8e40-573d457d2a12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/672f3925-05d6-493c-8e40-573d457d2a12', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f873e8a9fe49badc3e4e706827e5340d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f30201ea1234cb1a7ad9c088fbc70dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bfe01a1a4140b7af6f0cf780ef71ddb050b7ff023d0be227f8a70dfede57a89ab12d5eb9eb9248b8ead30d3d2d96ca0dff2dc6a6fd34722b3d464f3b29b2e891', 'id': '672f3925-05d6-493c-8e40-573d457d2a12', 'created_at': datetime.datetime(2026, 7, 9, 12, 32, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 12, 32, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/672f3925-05d6-493c-8e40-573d457d2a12/file', 'properties': {}}, 'image_service': }' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d76eb2-689a-4845-9a36-3cf79670a925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:05 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Volume volume-066c9b2b-f589-43ed-828a-a0febad5bbfd (066c9b2b-f589-43ed-828a-a0febad5bbfd): created successfully Jul 09 14:33:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d76eb2-689a-4845-9a36-3cf79670a925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Flow 'volume_create_manager' (e35bca95-d96d-4a01-83c1-f36bdb9a2e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:33:05 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-244036c5-a65c-4432-8b38-95c9dab64435 tempest-VolumeImageDependencyTests-1920294611 None] Created volume successfully. Jul 09 14:33:05 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 1.129s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:05 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:33:05 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] Deleted volume successfully. Jul 09 14:33:05 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-563845a7-61bb-47d1-ad57-13b2bd71390a tempest-ProjectReaderTests-1907246205 None] Lock "cinder-54c0ac44-0b28-4be6-a87f-5aca77e68762-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:06 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] Acquiring lock "cinder-066c9b2b-f589-43ed-828a-a0febad5bbfd-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:06 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] Lock "cinder-066c9b2b-f589-43ed-828a-a0febad5bbfd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:06 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] Acquiring lock "cinder-quobyte-066c9b2b-f589-43ed-828a-a0febad5bbfd" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:06 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] Lock "cinder-quobyte-066c9b2b-f589-43ed-828a-a0febad5bbfd" acquired by "delete_volume" :: waited 0.029s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:06 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f37eef4-d50f-4490-b4ea-57a049f58e24]: (4, 'raw') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:06 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd Jul 09 14:33:06 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:07 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd" returned: 0 in 0.971s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:07 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd Jul 09 14:33:07 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:08 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd" returned: 1 in 0.838s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd' failed. Not Retrying. {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 14:33:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:08 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd Jul 09 14:33:08 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:09 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-066c9b2b-f589-43ed-828a-a0febad5bbfd" returned: 0 in 0.707s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] Lock "cinder-quobyte-066c9b2b-f589-43ed-828a-a0febad5bbfd" released by "delete_volume" :: held 2.603s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] Created reservations ['45ef74c2-8826-47ab-bb97-702bdf31b26e', 'a578531a-0706-45e7-891d-e570786d81cf', '31124069-d4e1-4174-af50-1d139b7e1bce', '351e46f8-250b-44fe-b927-b5e145143572'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:09 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:33:09 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Flow 'volume_create_manager' (29db0cbb-bb75-49fd-8ed6-252fc35bb110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130db15b-eb84-44ab-b34d-72bf4e6109c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130db15b-eb84-44ab-b34d-72bf4e6109c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-754147746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6f044f-73f2-4897-ada4-b5bf445071ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bba6e5fbe534bdf9f3e3459b1cd2d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:09Z,use_quota=True,user_id='d1e928af629b46fab523964aa23893c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8fcd65-2a74-4681-9481-078401656ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8fcd65-2a74-4681-9481-078401656ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df6c247-7102-4693-9781-dd9c694fba80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df6c247-7102-4693-9781-dd9c694fba80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef6f044f-73f2-4897-ada4-b5bf445071ce', 'volume_name': 'volume-ef6f044f-73f2-4897-ada4-b5bf445071ce', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad8e183c-8060-498d-8c85-97ff57a7dade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad8e183c-8060-498d-8c85-97ff57a7dade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94afedc-bb5b-4b35-9eb5-5a09f3cc03f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:09 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Volume ef6f044f-73f2-4897-ada4-b5bf445071ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef6f044f-73f2-4897-ada4-b5bf445071ce', 'volume_size': 1} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-754147746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef6f044f-73f2-4897-ada4-b5bf445071ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bba6e5fbe534bdf9f3e3459b1cd2d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:09Z,use_quota=True,user_id='d1e928af629b46fab523964aa23893c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Creating volume ef6f044f-73f2-4897-ada4-b5bf445071ce {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:33:09 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:33:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:09 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce 1073741824 Jul 09 14:33:09 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:10 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.794s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:10 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:33:10 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] Deleted volume successfully. Jul 09 14:33:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-1d22aeb9-2088-4718-b1eb-63486eb1c46b tempest-VolumeImageDependencyTests-1920294611 None] Lock "cinder-066c9b2b-f589-43ed-828a-a0febad5bbfd-delete_volume" released by "delete_volume" :: held 3.694s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:10 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce 1073741824" returned: 0 in 1.011s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:10 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce Jul 09 14:33:10 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:11 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce" returned: 0 in 0.834s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:11 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:33:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94afedc-bb5b-4b35-9eb5-5a09f3cc03f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef6f044f-73f2-4897-ada4-b5bf445071ce', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f904e7-cb9c-4836-aa75-fd120f764acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:11 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Volume volume-ef6f044f-73f2-4897-ada4-b5bf445071ce (ef6f044f-73f2-4897-ada4-b5bf445071ce): created successfully Jul 09 14:33:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f904e7-cb9c-4836-aa75-fd120f764acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Flow 'volume_create_manager' (29db0cbb-bb75-49fd-8ed6-252fc35bb110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:33:11 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-159d5952-a6a2-46ec-a4b5-c7b4692e447d tempest-ProjectMemberTests-1994606433 None] Created volume successfully. Jul 09 14:33:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:33:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:33:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:33:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:12 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:33:12 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:13 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] Creating offline snapshot 1f3e2819-e3be-4897-9b2a-fa5f40879a9a of volume ef6f044f-73f2-4897-ada4-b5bf445071ce {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:33:13 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8e9165-135e-481b-ba8a-19fb9b0d4706]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:13 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.709s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:33:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:33:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:33:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:33:13 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce Jul 09 14:33:13 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:13 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce" returned: 0 in 0.833s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:14 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a 1G Jul 09 14:33:14 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:14 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-476e7030-ddb7-4f7b-8b91-d54fc6bd03dd tempest-ProjectAdminTests-1251846717 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7545547485352, 'free_capacity_gb': 1775.7545547485352, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87011) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 14:33:14 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a 1G" returned: 0 in 0.838s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef6f044f-73f2-4897-ada4-b5bf445071ce -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:14 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef6f044f-73f2-4897-ada4-b5bf445071ce -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a Jul 09 14:33:14 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:15 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:33:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Flow 'volume_create_manager' (9b781895-53f4-4bd2-9992-477cdde08914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:33:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a76432-47bf-462b-be0a-7c16f351744a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a76432-47bf-462b-be0a-7c16f351744a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1915575728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a1aaefcb814102b9e44adbf90f0a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:15Z,use_quota=True,user_id='c6a8cf2ec91340b58f526a25ec672ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939f4ea1-c4ca-4f0e-a2c3-438131304817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939f4ea1-c4ca-4f0e-a2c3-438131304817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72098ba-235d-4ef0-acb7-b38168be3e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d72098ba-235d-4ef0-acb7-b38168be3e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec', 'volume_name': 'volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdff6afe-55f7-4fb1-81c7-008e30105cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdff6afe-55f7-4fb1-81c7-008e30105cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:15 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc9baa6-4adb-4341-b5dd-0c1b6be80c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:15 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Volume 98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec', 'volume_size': 1} Jul 09 14:33:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:15 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef6f044f-73f2-4897-ada4-b5bf445071ce -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a" returned: 0 in 0.779s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:15 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a is being set with open permissions: ugo+rw Jul 09 14:33:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:15 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a Jul 09 14:33:15 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:16 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a" returned: 0 in 0.733s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:16 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.info Jul 09 14:33:16 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:17 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.info" returned: 0 in 0.742s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:17 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.info is being set with open permissions: ugo+rw Jul 09 14:33:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:17 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.info Jul 09 14:33:17 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:17 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.info" returned: 0 in 0.695s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.735s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.577s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1915575728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a1aaefcb814102b9e44adbf90f0a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:15Z,use_quota=True,user_id='c6a8cf2ec91340b58f526a25ec672ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:33:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Creating volume 98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:33:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:33:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:33:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:33:17 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:33:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:17 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec 1073741824 Jul 09 14:33:17 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:17 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-99182f9a-c9a0-413a-8d85-37e391a16a39 tempest-ProjectMemberTests-1994606433 None] Create snapshot completed successfully Jul 09 14:33:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-1f3e2819-e3be-4897-9b2a-fa5f40879a9a-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-1f3e2819-e3be-4897-9b2a-fa5f40879a9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-ef6f044f-73f2-4897-ada4-b5bf445071ce" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-ef6f044f-73f2-4897-ada4-b5bf445071ce" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-1f3e2819-e3be-4897-9b2a-fa5f40879a9a" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-1f3e2819-e3be-4897-9b2a-fa5f40879a9a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] Deleting offline snapshot 1f3e2819-e3be-4897-9b2a-fa5f40879a9a of volume ef6f044f-73f2-4897-ada4-b5bf445071ce {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:33:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] snapshot_file for this snap is: volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:33:18 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[296506f5-5a8d-4b8e-9a0d-7b96052dad2a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:18 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a Jul 09 14:33:18 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:18 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec 1073741824" returned: 0 in 1.064s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:19 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec Jul 09 14:33:19 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:19 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a" returned: 0 in 0.873s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef6f044f-73f2-4897-ada4-b5bf445071ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:33:19 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1ac2a7-f137-4bf0-9753-c277c4b4bcc1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:19 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce Jul 09 14:33:19 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:19 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec" returned: 0 in 0.709s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:33:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc9baa6-4adb-4341-b5dd-0c1b6be80c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfbb4b72-cc92-4050-ad70-cf7cb07cfac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:19 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Volume volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec (98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec): created successfully Jul 09 14:33:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfbb4b72-cc92-4050-ad70-cf7cb07cfac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Flow 'volume_create_manager' (9b781895-53f4-4bd2-9992-477cdde08914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:33:19 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-5253c33f-9ba7-4ce5-8dfc-d2ad5eec2c43 tempest-ProjectReaderTests-1642326272 None] Created volume successfully. Jul 09 14:33:20 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce" returned: 0 in 0.817s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:20 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a Jul 09 14:33:20 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] Creating offline snapshot 677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd of volume 98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:33:20 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0746de8-e69c-47af-a50f-13162fc230d0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:20 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec Jul 09 14:33:20 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:21 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a" returned: 0 in 0.838s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:21 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a Jul 09 14:33:21 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:21 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec" returned: 0 in 0.957s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:21 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce.1f3e2819-e3be-4897-9b2a-fa5f40879a9a" returned: 0 in 0.735s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:21 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd 1G Jul 09 14:33:21 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-1f3e2819-e3be-4897-9b2a-fa5f40879a9a" released by "_delete_snapshot" :: held 3.396s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-ef6f044f-73f2-4897-ada4-b5bf445071ce" released by "delete_snapshot" :: held 3.423s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:21 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] Created reservations ['9a606f93-b327-45f3-ab21-569d3895e58c', '6fca8cc3-6711-4fe6-907c-c350906de39c', '20651969-38bc-4300-9c39-37068f92d9dd', '8d46150a-f103-4329-ae55-1450cc3a9bff'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:33:21 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] Delete snapshot completed successfully. Jul 09 14:33:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-80d15ddc-8078-4f72-a2f6-e22ab1683475 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-1f3e2819-e3be-4897-9b2a-fa5f40879a9a-delete_snapshot" released by "delete_snapshot" :: held 3.569s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-ef6f044f-73f2-4897-ada4-b5bf445071ce-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:22 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] Lock "cinder-ef6f044f-73f2-4897-ada4-b5bf445071ce-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd 1G" returned: 0 in 0.913s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:22 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd Jul 09 14:33:22 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-ef6f044f-73f2-4897-ada4-b5bf445071ce" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-ef6f044f-73f2-4897-ada4-b5bf445071ce" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:22 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f895da49-5818-440c-ab06-f82bbce7f64c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:22 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce Jul 09 14:33:22 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:23 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd" returned: 0 in 0.770s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:23 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd is being set with open permissions: ugo+rw Jul 09 14:33:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:23 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd Jul 09 14:33:23 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:23 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce" returned: 0 in 0.868s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:23 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce Jul 09 14:33:23 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:24 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd" returned: 0 in 0.725s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:24 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.info Jul 09 14:33:24 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:24 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ef6f044f-73f2-4897-ada4-b5bf445071ce" returned: 0 in 0.774s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-ef6f044f-73f2-4897-ada4-b5bf445071ce" released by "delete_volume" :: held 1.747s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:24 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] Created reservations ['a9a78ffe-9cea-4454-a4cf-8e9971534b17', 'd000d8e3-b180-4b79-ba18-48d033ef26f2', 'c7d71b94-350d-4a62-9117-aa2b58b60d93', 'dfd729b7-5855-43d2-9b38-59a5042ad861'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:33:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:33:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:33:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:24 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:33:24 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:25 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.info" returned: 0 in 0.844s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:25 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.info is being set with open permissions: ugo+rw Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:25 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.info Jul 09 14:33:25 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Flow 'volume_create_manager' (1bcd68d3-11a0-41f5-8aa7-8d70a2bacebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef449502-f1d7-4b04-b083-bd0d8b58062f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef449502-f1d7-4b04-b083-bd0d8b58062f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-410663227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bba6e5fbe534bdf9f3e3459b1cd2d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:25Z,use_quota=True,user_id='d1e928af629b46fab523964aa23893c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c45ffe-f858-4cc3-b5fe-50d2e629e8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c45ffe-f858-4cc3-b5fe-50d2e629e8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2583cc-20af-4e9b-9c71-9b99b364192a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2583cc-20af-4e9b-9c71-9b99b364192a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff', 'volume_name': 'volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae9eb32-a40c-411d-a573-3224d151ba45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:25 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae9eb32-a40c-411d-a573-3224d151ba45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2490f079-407e-4ca0-bc15-2abe80b5bca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:25 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Volume c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff', 'volume_size': 1} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.941s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:33:25 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] Deleted volume successfully. Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-44c62c7e-c29b-453e-8621-02e53b08120a tempest-ProjectMemberTests-1994606433 None] Lock "cinder-ef6f044f-73f2-4897-ada4-b5bf445071ce-delete_volume" released by "delete_volume" :: held 2.969s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:25 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.info" returned: 0 in 0.822s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.142s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.288s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-410663227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bba6e5fbe534bdf9f3e3459b1cd2d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:25Z,use_quota=True,user_id='d1e928af629b46fab523964aa23893c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Creating volume c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:33:25 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:33:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:25 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff 1073741824 Jul 09 14:33:25 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:25 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-eb48eda2-ddcc-4d4f-b8cb-758756f6539b tempest-ProjectReaderTests-1642326272 None] Create snapshot completed successfully Jul 09 14:33:26 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff 1073741824" returned: 0 in 0.935s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:26 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff Jul 09 14:33:26 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-quobyte-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-quobyte-677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:27 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:27 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] Deleting offline snapshot 677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd of volume 98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:33:27 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] snapshot_file for this snap is: volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:33:27 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec8bb90-98f7-41c0-ab2a-2a2e101c8057]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:27 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd Jul 09 14:33:27 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:27 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff" returned: 0 in 0.729s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:27 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:33:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2490f079-407e-4ca0-bc15-2abe80b5bca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b3464f-5395-45ae-b87b-a19f3d7671ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:27 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Volume volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff (c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff): created successfully Jul 09 14:33:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b3464f-5395-45ae-b87b-a19f3d7671ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:27 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Flow 'volume_create_manager' (1bcd68d3-11a0-41f5-8aa7-8d70a2bacebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:33:27 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-48e8319b-576e-4aa3-a139-da1cb5a90a35 tempest-ProjectMemberTests-1994606433 None] Created volume successfully. Jul 09 14:33:28 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd" returned: 0 in 0.913s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:33:28 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4b3167-dc4c-4a4c-832a-e3223b17aeff]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:28 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec Jul 09 14:33:28 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:28 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] Creating offline snapshot 4eecfee5-be19-47b9-8d69-c36b85ff45c6 of volume c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:33:28 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99fdee2-4b18-4a6d-b4d3-f95d64c03bad]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:28 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff Jul 09 14:33:28 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:29 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec" returned: 0 in 0.848s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:29 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd Jul 09 14:33:29 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:29 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff" returned: 0 in 0.798s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:29 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6 1G Jul 09 14:33:29 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:30 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd" returned: 0 in 0.889s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:30 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd Jul 09 14:33:30 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:30 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6 1G" returned: 0 in 0.881s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:30 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6 Jul 09 14:33:30 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:30 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec.677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd" returned: 0 in 0.694s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd" released by "_delete_snapshot" :: held 3.491s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec" released by "delete_snapshot" :: held 3.527s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:30 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] Created reservations ['fecc36ce-e015-4959-84ac-1561a9cc9c97', '868e6b5b-d3bb-4838-9da9-f3ac642aa527', 'd1868419-5d10-4c10-9a5e-f978fdbcc1d4', 'e73ba435-f393-438c-8e32-66a4f3144acd'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:33:30 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] Delete snapshot completed successfully. Jul 09 14:33:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-d764bb43-fca0-4bf1-be9a-c787059ac499 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-677b30c8-ba3c-4fdb-b4e5-b38574ccb2fd-delete_snapshot" released by "delete_snapshot" :: held 3.714s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:31 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6" returned: 0 in 0.700s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:31 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6 is being set with open permissions: ugo+rw Jul 09 14:33:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:31 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6 Jul 09 14:33:31 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-quobyte-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec" acquired by "delete_volume" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:31 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb19316-d820-410b-ae9f-c6eac74f23c0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:31 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec Jul 09 14:33:31 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:31 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6" returned: 0 in 0.666s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:31 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:DELETE=14,cinder:SELECT=138,cinder:INSERT=56,cinder:UPDATE=165 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:33:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:31 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.info Jul 09 14:33:31 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:32 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec" returned: 0 in 0.831s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:32 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec Jul 09 14:33:32 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:32 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.info" returned: 0 in 0.640s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:32 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.info is being set with open permissions: ugo+rw Jul 09 14:33:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:32 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.info Jul 09 14:33:32 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:33 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec" returned: 0 in 0.709s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:33 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec" released by "delete_volume" :: held 1.610s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:33 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.info" returned: 0 in 0.649s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.443s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:33 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-023e2a04-374b-4467-a5e9-b898a2a1893d tempest-ProjectMemberTests-1994606433 None] Create snapshot completed successfully Jul 09 14:33:33 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] Created reservations ['1c94519d-ff10-4ca7-81d3-e96c7b119865', '85737093-b647-4def-abbd-ed916a481a91', 'a6d8853a-5b12-427a-9023-2424ea91400a', '2c69fa62-5fd8-4c7e-9780-5606d65eafac'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:33:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:33:33 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:33:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:33 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:33:33 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:34 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-4eecfee5-be19-47b9-8d69-c36b85ff45c6-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.696s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:33:34 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] Deleted volume successfully. Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-4eecfee5-be19-47b9-8d69-c36b85ff45c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-4eecfee5-be19-47b9-8d69-c36b85ff45c6" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-dcccd91c-5059-48a3-84c0-9a1bfc34bbe3 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-98b1dfdb-a2c6-4a1f-8329-ef2d2cdc83ec-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-4eecfee5-be19-47b9-8d69-c36b85ff45c6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] Deleting offline snapshot 4eecfee5-be19-47b9-8d69-c36b85ff45c6 of volume c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] snapshot_file for this snap is: volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[dade307c-ff75-4fba-8972-e5402d9ae8ab]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:INSERT=39,cinder:UPDATE=172,cinder:SELECT=123,cinder:DELETE=14 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:33:34 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6 Jul 09 14:33:34 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Flow 'volume_create_manager' (d4eb9d18-5ac3-41b5-86c4-1a3b4f71c6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0091eea2-d8a2-46a8-950c-000320fab9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0091eea2-d8a2-46a8-950c-000320fab9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1912135998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ebd0cb-ab71-4630-a72a-dc47642126c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a1aaefcb814102b9e44adbf90f0a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:34Z,use_quota=True,user_id='c6a8cf2ec91340b58f526a25ec672ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4736b81-bcbb-4589-ba0c-04f80490be9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4736b81-bcbb-4589-ba0c-04f80490be9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc3338b4-b586-4888-99a4-c4ad0b7e2e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc3338b4-b586-4888-99a4-c4ad0b7e2e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ebd0cb-ab71-4630-a72a-dc47642126c1', 'volume_name': 'volume-75ebd0cb-ab71-4630-a72a-dc47642126c1', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a860aa-0e5b-4b52-9c4a-0b68153c813e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a860aa-0e5b-4b52-9c4a-0b68153c813e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6701884a-7927-4625-a5a3-620c5c4a4f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:34 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Volume 75ebd0cb-ab71-4630-a72a-dc47642126c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ebd0cb-ab71-4630-a72a-dc47642126c1', 'volume_size': 1} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1912135998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ebd0cb-ab71-4630-a72a-dc47642126c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a1aaefcb814102b9e44adbf90f0a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:34Z,use_quota=True,user_id='c6a8cf2ec91340b58f526a25ec672ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Creating volume 75ebd0cb-ab71-4630-a72a-dc47642126c1 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:33:34 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:34 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1 1073741824 Jul 09 14:33:34 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:34 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6" returned: 0 in 0.793s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:34 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:33:35 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4ad270-506c-4eb1-a63a-6082075d360c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:35 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff Jul 09 14:33:35 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:35 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1 1073741824" returned: 0 in 0.912s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:35 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1 Jul 09 14:33:35 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:35 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff" returned: 0 in 0.850s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:35 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6 Jul 09 14:33:35 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:36 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1" returned: 0 in 0.675s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:33:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6701884a-7927-4625-a5a3-620c5c4a4f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ebd0cb-ab71-4630-a72a-dc47642126c1', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d592c0f9-1f90-4da3-a836-3756d6a6051e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:36 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Volume volume-75ebd0cb-ab71-4630-a72a-dc47642126c1 (75ebd0cb-ab71-4630-a72a-dc47642126c1): created successfully Jul 09 14:33:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d592c0f9-1f90-4da3-a836-3756d6a6051e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:36 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Flow 'volume_create_manager' (d4eb9d18-5ac3-41b5-86c4-1a3b4f71c6ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:33:36 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-901d7fb8-b16d-4cbf-baeb-eca69647d2c6 tempest-ProjectReaderTests-1642326272 None] Created volume successfully. Jul 09 14:33:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:36 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] Creating offline snapshot 5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a of volume 75ebd0cb-ab71-4630-a72a-dc47642126c1 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:33:36 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f2f7fe-e78f-42d1-a15b-1ad867df0d65]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:36 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1 Jul 09 14:33:36 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:36 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6" returned: 0 in 0.798s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:36 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6 Jul 09 14:33:36 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:37 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1" returned: 0 in 0.782s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:37 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:37 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a 1G Jul 09 14:33:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff.4eecfee5-be19-47b9-8d69-c36b85ff45c6" returned: 0 in 0.672s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:37 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-4eecfee5-be19-47b9-8d69-c36b85ff45c6" released by "_delete_snapshot" :: held 3.215s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff" released by "delete_snapshot" :: held 3.240s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:37 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] Created reservations ['87cc0cd8-551a-41a3-9e4b-36ab34a86b7c', 'e80df5ed-5160-40d7-a311-f9d7d8916154', 'd3778f54-7b41-43b8-af09-8f3cc2e4b5e1', '99f38ffc-e405-415b-84a6-c0484d29d27d'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:33:37 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] Delete snapshot completed successfully. Jul 09 14:33:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f1543230-4434-4df0-a0f7-b80c31814d88 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-4eecfee5-be19-47b9-8d69-c36b85ff45c6-delete_snapshot" released by "delete_snapshot" :: held 3.394s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:38 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a 1G" returned: 0 in 0.794s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ebd0cb-ab71-4630-a72a-dc47642126c1 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:38 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ebd0cb-ab71-4630-a72a-dc47642126c1 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a Jul 09 14:33:38 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:38 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:38 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] Lock "cinder-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:38 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:38 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff" acquired by "delete_volume" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:38 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b7c550-b730-430d-b3cd-eb911bb34ff7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:38 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff Jul 09 14:33:38 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:38 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ebd0cb-ab71-4630-a72a-dc47642126c1 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a" returned: 0 in 0.756s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:38 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a is being set with open permissions: ugo+rw Jul 09 14:33:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:38 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a Jul 09 14:33:38 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:39 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff" returned: 0 in 0.777s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:39 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff Jul 09 14:33:39 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:39 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a" returned: 0 in 0.713s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:39 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.info Jul 09 14:33:39 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:39 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff" returned: 0 in 0.675s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:39 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff" released by "delete_volume" :: held 1.511s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:40 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] Created reservations ['5b6c74a3-0953-4502-a058-08a546a5085d', '4526ddf8-be5c-4199-b1d7-302b94d30f9f', '1834ea05-482d-4d56-b20d-9553da719f2f', 'b6dca879-d6da-44c7-a301-bc8506c34996'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:33:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:33:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:33:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:40 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:33:40 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:40 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.info" returned: 0 in 0.654s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:40 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.info is being set with open permissions: ugo+rw Jul 09 14:33:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:40 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.info Jul 09 14:33:40 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:40 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.678s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:40 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:33:40 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] Deleted volume successfully. Jul 09 14:33:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-fa8bcb8a-e314-4f65-af28-75cc5076162a tempest-ProjectMemberTests-1994606433 None] Lock "cinder-c8b45ddc-a4d0-4a2a-a529-dea99c1c93ff-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:40 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.info" returned: 0 in 0.701s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.499s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:41 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-7e5a3962-b40b-4374-aff5-44568d1b18e4 tempest-ProjectReaderTests-1642326272 None] Create snapshot completed successfully Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Flow 'volume_create_manager' (f02587b2-ddae-4b1d-9cb4-97c3c36d2acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d83ea9-0951-4b85-b138-13cabe933f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d83ea9-0951-4b85-b138-13cabe933f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1500417272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba71746d-3841-4608-87fe-bc5efd61d761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bba6e5fbe534bdf9f3e3459b1cd2d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:41Z,use_quota=True,user_id='d1e928af629b46fab523964aa23893c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba2b9d2-e56d-4e8c-84c0-f247f086953a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba2b9d2-e56d-4e8c-84c0-f247f086953a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5208f8e2-c22c-4a40-bc2b-c82967984219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5208f8e2-c22c-4a40-bc2b-c82967984219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba71746d-3841-4608-87fe-bc5efd61d761', 'volume_name': 'volume-ba71746d-3841-4608-87fe-bc5efd61d761', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300169c1-9a23-4948-ba1c-6c96ed5120ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300169c1-9a23-4948-ba1c-6c96ed5120ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28799d3e-33fe-479e-948d-85a4718a7907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:41 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Volume ba71746d-3841-4608-87fe-bc5efd61d761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba71746d-3841-4608-87fe-bc5efd61d761', 'volume_size': 1} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1500417272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba71746d-3841-4608-87fe-bc5efd61d761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bba6e5fbe534bdf9f3e3459b1cd2d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:41Z,use_quota=True,user_id='d1e928af629b46fab523964aa23893c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Creating volume ba71746d-3841-4608-87fe-bc5efd61d761 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:33:41 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:41 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761 1073741824 Jul 09 14:33:41 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] Lock "cinder-5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-quobyte-75ebd0cb-ab71-4630-a72a-dc47642126c1" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-75ebd0cb-ab71-4630-a72a-dc47642126c1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-quobyte-5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] Deleting offline snapshot 5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a of volume 75ebd0cb-ab71-4630-a72a-dc47642126c1 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] snapshot_file for this snap is: volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f10302b-ccfe-4ee8-b1dd-5326ca0fd3da]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:41 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a Jul 09 14:33:41 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:42 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761 1073741824" returned: 0 in 0.902s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:42 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761 Jul 09 14:33:42 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:42 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a" returned: 0 in 0.785s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75ebd0cb-ab71-4630-a72a-dc47642126c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:33:42 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5846bd9-de0b-43f8-acf7-832c08bdcd8b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:42 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761" returned: 0 in 0.675s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:33:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:42 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1 Jul 09 14:33:42 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28799d3e-33fe-479e-948d-85a4718a7907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba71746d-3841-4608-87fe-bc5efd61d761', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebead098-440d-4812-87d3-09e98c42279a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:42 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Volume volume-ba71746d-3841-4608-87fe-bc5efd61d761 (ba71746d-3841-4608-87fe-bc5efd61d761): created successfully Jul 09 14:33:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebead098-440d-4812-87d3-09e98c42279a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Flow 'volume_create_manager' (f02587b2-ddae-4b1d-9cb4-97c3c36d2acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:33:42 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-688362b2-2044-44c1-b788-3153f591dd5f tempest-ProjectMemberTests-1994606433 None] Created volume successfully. Jul 09 14:33:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:43 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] Creating offline snapshot 4df0df9b-df05-4257-a2da-ec945d2f52cb of volume ba71746d-3841-4608-87fe-bc5efd61d761 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:33:43 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc36e7c-14c5-48c5-bc38-38e788f994e6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:43 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1" returned: 0 in 0.777s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:43 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761 Jul 09 14:33:43 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:43 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a Jul 09 14:33:43 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:44 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761" returned: 0 in 0.780s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:44 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb 1G Jul 09 14:33:44 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:44 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a" returned: 0 in 0.747s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:44 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a Jul 09 14:33:44 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:44 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1.5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a" returned: 0 in 0.666s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:44 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a" released by "_delete_snapshot" :: held 3.080s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:44 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-75ebd0cb-ab71-4630-a72a-dc47642126c1" released by "delete_snapshot" :: held 3.106s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:44 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] Created reservations ['54ecb865-264d-4254-92a4-f22c57894895', '6275773a-36eb-47ab-9a56-8632040c8cc5', '7df58e18-0af8-4c48-b758-fce6992e6e94', '65ff6358-49bf-4d7b-b3a0-907b733c09bc'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:33:45 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] Delete snapshot completed successfully. Jul 09 14:33:45 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad13f2c1-d625-4248-b975-aea3612d580c tempest-ProjectReaderTests-1642326272 None] Lock "cinder-5b0a14b4-63fd-4bb3-9a59-56ab4ce5547a-delete_snapshot" released by "delete_snapshot" :: held 3.244s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:45 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb 1G" returned: 0 in 0.896s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba71746d-3841-4608-87fe-bc5efd61d761 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:45 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba71746d-3841-4608-87fe-bc5efd61d761 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb Jul 09 14:33:45 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:45 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba71746d-3841-4608-87fe-bc5efd61d761 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb" returned: 0 in 0.666s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:45 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb is being set with open permissions: ugo+rw Jul 09 14:33:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:45 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb Jul 09 14:33:45 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:46 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-75ebd0cb-ab71-4630-a72a-dc47642126c1-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:46 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] Lock "cinder-75ebd0cb-ab71-4630-a72a-dc47642126c1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:46 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-quobyte-75ebd0cb-ab71-4630-a72a-dc47642126c1" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:46 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-75ebd0cb-ab71-4630-a72a-dc47642126c1" acquired by "delete_volume" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:46 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe0e957-d6ed-4b7c-8622-c142d2de519d]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:46 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1 Jul 09 14:33:46 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:46 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb" returned: 0 in 0.681s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:46 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.info Jul 09 14:33:46 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:46 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1" returned: 0 in 0.747s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:46 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1 Jul 09 14:33:46 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:47 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.info" returned: 0 in 0.741s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:47 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.info is being set with open permissions: ugo+rw Jul 09 14:33:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:47 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.info Jul 09 14:33:47 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:47 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-75ebd0cb-ab71-4630-a72a-dc47642126c1" returned: 0 in 0.664s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-75ebd0cb-ab71-4630-a72a-dc47642126c1" released by "delete_volume" :: held 1.475s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:47 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] Created reservations ['d5c4c342-35c0-46aa-b666-205ce3cd7277', '7599c4af-6274-405a-9e1f-d73cb1357d79', '0c65ca30-1735-4c50-8d7f-a31a2e618b1b', 'ec2392e2-8bd4-4aeb-bc03-32f8397d6898'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:33:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:33:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:33:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:47 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:33:47 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:47 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.info" returned: 0 in 0.655s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.507s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:47 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-8faa7ff9-7f8c-448e-8872-d5cc69a981e4 tempest-ProjectMemberTests-1994606433 None] Create snapshot completed successfully Jul 09 14:33:48 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.654s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:33:48 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] Deleted volume successfully. Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b1bc5316-0945-4555-a06c-2a92377a80fa tempest-ProjectReaderTests-1642326272 None] Lock "cinder-75ebd0cb-ab71-4630-a72a-dc47642126c1-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-4df0df9b-df05-4257-a2da-ec945d2f52cb-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-4df0df9b-df05-4257-a2da-ec945d2f52cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-ba71746d-3841-4608-87fe-bc5efd61d761" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-ba71746d-3841-4608-87fe-bc5efd61d761" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-4df0df9b-df05-4257-a2da-ec945d2f52cb" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-4df0df9b-df05-4257-a2da-ec945d2f52cb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] Deleting offline snapshot 4df0df9b-df05-4257-a2da-ec945d2f52cb of volume ba71746d-3841-4608-87fe-bc5efd61d761 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] snapshot_file for this snap is: volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d375793-adde-4bb2-bd94-3c86401a6571]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Flow 'volume_create_manager' (4d5688a2-1208-40ca-9266-20dc200e33b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4230feb3-ac40-4c44-bf5b-c7e37b7de721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4230feb3-ac40-4c44-bf5b-c7e37b7de721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557243205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7a0990-babf-4b21-b37f-c595c1a495af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a1aaefcb814102b9e44adbf90f0a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:49Z,use_quota=True,user_id='c6a8cf2ec91340b58f526a25ec672ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0217e1b9-db92-4d60-a21b-951f83d7ecab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0217e1b9-db92-4d60-a21b-951f83d7ecab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4853952-d3e0-4a6c-b21b-9215375378f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4853952-d3e0-4a6c-b21b-9215375378f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce7a0990-babf-4b21-b37f-c595c1a495af', 'volume_name': 'volume-ce7a0990-babf-4b21-b37f-c595c1a495af', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:48 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb Jul 09 14:33:48 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6c9f7b-cbb1-44eb-b621-516e4566a10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6c9f7b-cbb1-44eb-b621-516e4566a10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fd4a45-84a0-48e7-87b9-327357aaeb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:48 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Volume ce7a0990-babf-4b21-b37f-c595c1a495af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce7a0990-babf-4b21-b37f-c595c1a495af', 'volume_size': 1} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557243205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7a0990-babf-4b21-b37f-c595c1a495af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a1aaefcb814102b9e44adbf90f0a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:49Z,use_quota=True,user_id='c6a8cf2ec91340b58f526a25ec672ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Creating volume ce7a0990-babf-4b21-b37f-c595c1a495af {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:33:48 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:33:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:48 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af 1073741824 Jul 09 14:33:48 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:49 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb" returned: 0 in 0.765s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:49 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba71746d-3841-4608-87fe-bc5efd61d761(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:33:49 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fb503b-1cd8-4d4d-af80-79a0d55c74f7]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:49 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761 Jul 09 14:33:49 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:49 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af 1073741824" returned: 0 in 0.897s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:49 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af Jul 09 14:33:49 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:50 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761" returned: 0 in 0.749s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:50 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb Jul 09 14:33:50 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:50 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af" returned: 0 in 0.664s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:33:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fd4a45-84a0-48e7-87b9-327357aaeb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce7a0990-babf-4b21-b37f-c595c1a495af', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc3ea06-4604-412a-b279-468ac3a44391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:50 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Volume volume-ce7a0990-babf-4b21-b37f-c595c1a495af (ce7a0990-babf-4b21-b37f-c595c1a495af): created successfully Jul 09 14:33:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc3ea06-4604-412a-b279-468ac3a44391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:50 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Flow 'volume_create_manager' (4d5688a2-1208-40ca-9266-20dc200e33b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:33:50 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-6b293d38-d410-438f-8c41-f1b5d5740510 tempest-ProjectReaderTests-1642326272 None] Created volume successfully. Jul 09 14:33:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:50 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] Creating offline snapshot 829f2c44-3419-4b8a-9bda-706fadabfdc3 of volume ce7a0990-babf-4b21-b37f-c595c1a495af {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:33:50 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb" returned: 0 in 0.774s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:51 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d1d170-cb3f-4096-a10d-302ec3e2f82b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:51 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb Jul 09 14:33:51 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:51 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af Jul 09 14:33:51 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:51 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761.4df0df9b-df05-4257-a2da-ec945d2f52cb" returned: 0 in 0.659s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-4df0df9b-df05-4257-a2da-ec945d2f52cb" released by "_delete_snapshot" :: held 3.052s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-ba71746d-3841-4608-87fe-bc5efd61d761" released by "delete_snapshot" :: held 3.083s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:51 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] Created reservations ['38ec83ee-c6f7-4e09-bf9e-4950fdbf3bb2', 'd6111268-6251-4def-ae6a-2b6a974ccb81', '07374d04-b775-4093-b605-9ad15554f0d6', 'bbce0d92-3a17-42ef-88ec-3b0d7fc5c1f5'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:33:51 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af" returned: 0 in 0.760s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:51 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3 1G Jul 09 14:33:51 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:51 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] Delete snapshot completed successfully. Jul 09 14:33:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-a4ce633d-1158-44d4-a585-3ae143692655 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-4df0df9b-df05-4257-a2da-ec945d2f52cb-delete_snapshot" released by "delete_snapshot" :: held 3.237s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:52 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3 1G" returned: 0 in 0.761s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce7a0990-babf-4b21-b37f-c595c1a495af -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:52 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce7a0990-babf-4b21-b37f-c595c1a495af -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3 Jul 09 14:33:52 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-ba71746d-3841-4608-87fe-bc5efd61d761-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] Lock "cinder-ba71746d-3841-4608-87fe-bc5efd61d761-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-ba71746d-3841-4608-87fe-bc5efd61d761" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-ba71746d-3841-4608-87fe-bc5efd61d761" acquired by "delete_volume" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:52 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14b37eb-8bc0-4295-9438-aa76b4421a52]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:53 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761 Jul 09 14:33:53 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:53 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce7a0990-babf-4b21-b37f-c595c1a495af -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3" returned: 0 in 0.703s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:53 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3 is being set with open permissions: ugo+rw Jul 09 14:33:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:53 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3 Jul 09 14:33:53 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:53 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761" returned: 0 in 0.733s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:53 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761 Jul 09 14:33:53 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:53 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3" returned: 0 in 0.638s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:53 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.info Jul 09 14:33:53 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:54 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ba71746d-3841-4608-87fe-bc5efd61d761" returned: 0 in 0.642s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:54 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-ba71746d-3841-4608-87fe-bc5efd61d761" released by "delete_volume" :: held 1.440s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:54 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] Created reservations ['84598c88-eca9-4ff4-9ede-ec195b037ebf', '2494958d-0a60-458c-91ad-6b0cec5b6bed', 'e1bcb252-34e4-4cb6-a050-a849ee18208e', 'e903ddbc-ff8b-4d46-b9a0-48827803950b'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:33:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:33:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:33:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:54 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:33:54 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:54 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.info" returned: 0 in 0.633s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:54 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.info is being set with open permissions: ugo+rw Jul 09 14:33:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:54 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.info Jul 09 14:33:54 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:55 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.660s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:33:55 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] Deleted volume successfully. Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f4e21179-a57b-4fc6-8a26-2826763ea7ab tempest-ProjectMemberTests-1994606433 None] Lock "cinder-ba71746d-3841-4608-87fe-bc5efd61d761-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:55 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.info" returned: 0 in 0.701s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.291s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:55 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-129c04a9-dd98-49ce-ad54-3963181ff498 tempest-ProjectReaderTests-1642326272 None] Create snapshot completed successfully Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Flow 'volume_create_manager' (0547db6d-43b0-41e4-bb55-ab433898f923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990f0f61-ba02-4885-a4bb-705fad720e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990f0f61-ba02-4885-a4bb-705fad720e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1812434590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d12302c-f832-4a4e-a1b1-258edc0ad5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bba6e5fbe534bdf9f3e3459b1cd2d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:55Z,use_quota=True,user_id='d1e928af629b46fab523964aa23893c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8842911-8561-4743-b323-2fa966346d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8842911-8561-4743-b323-2fa966346d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c70dc3-7c5a-4f82-8b9d-0298ee523047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75c70dc3-7c5a-4f82-8b9d-0298ee523047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d12302c-f832-4a4e-a1b1-258edc0ad5af', 'volume_name': 'volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b653d924-9c29-4f1e-afb6-20964c5c65df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b653d924-9c29-4f1e-afb6-20964c5c65df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d7153e-e400-495c-9a76-90d6c9be48a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:55 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Volume 6d12302c-f832-4a4e-a1b1-258edc0ad5af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af', 'volume_size': 1} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1812434590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d12302c-f832-4a4e-a1b1-258edc0ad5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bba6e5fbe534bdf9f3e3459b1cd2d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:33:55Z,use_quota=True,user_id='d1e928af629b46fab523964aa23893c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Creating volume 6d12302c-f832-4a4e-a1b1-258edc0ad5af {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:33:55 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:33:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:55 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af 1073741824 Jul 09 14:33:55 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-829f2c44-3419-4b8a-9bda-706fadabfdc3-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-829f2c44-3419-4b8a-9bda-706fadabfdc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-quobyte-ce7a0990-babf-4b21-b37f-c595c1a495af" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-ce7a0990-babf-4b21-b37f-c595c1a495af" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-quobyte-829f2c44-3419-4b8a-9bda-706fadabfdc3" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:33:56 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-829f2c44-3419-4b8a-9bda-706fadabfdc3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:33:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] Deleting offline snapshot 829f2c44-3419-4b8a-9bda-706fadabfdc3 of volume ce7a0990-babf-4b21-b37f-c595c1a495af {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:33:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] snapshot_file for this snap is: volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:33:56 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7064c0d-6778-4361-9b8c-1ecf61da97da]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:56 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3 Jul 09 14:33:56 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:56 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af 1073741824" returned: 0 in 0.891s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:56 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af Jul 09 14:33:56 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:57 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3" returned: 0 in 0.740s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce7a0990-babf-4b21-b37f-c595c1a495af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:33:57 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98a0927-8e02-426c-8c94-bddc64c451b6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:57 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af" returned: 0 in 0.630s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:33:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:33:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d7153e-e400-495c-9a76-90d6c9be48a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf040d1-00cd-4c29-9a0e-11a7f197ac6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:33:57 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af Jul 09 14:33:57 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:57 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Volume volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af (6d12302c-f832-4a4e-a1b1-258edc0ad5af): created successfully Jul 09 14:33:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf040d1-00cd-4c29-9a0e-11a7f197ac6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:33:57 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Flow 'volume_create_manager' (0547db6d-43b0-41e4-bb55-ab433898f923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:33:57 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d24ef782-c3ae-43c9-b6b0-702551e5f2fa tempest-ProjectMemberTests-1994606433 None] Created volume successfully. Jul 09 14:33:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:33:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:33:57 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] Creating offline snapshot 75dc9f59-80cb-4721-a28f-61e4a7a96d8c of volume 6d12302c-f832-4a4e-a1b1-258edc0ad5af {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:33:57 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f151512a-3d52-4e25-bf84-ed62a7ecccae]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:33:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:57 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af" returned: 0 in 0.771s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:57 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3 Jul 09 14:33:57 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:57 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af Jul 09 14:33:57 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:58 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af" returned: 0 in 0.768s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:58 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c 1G Jul 09 14:33:58 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:58 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3" returned: 0 in 0.766s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:58 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3 Jul 09 14:33:58 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:59 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af.829f2c44-3419-4b8a-9bda-706fadabfdc3" returned: 0 in 0.655s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-829f2c44-3419-4b8a-9bda-706fadabfdc3" released by "_delete_snapshot" :: held 3.023s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:59 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-ce7a0990-babf-4b21-b37f-c595c1a495af" released by "delete_snapshot" :: held 3.048s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c 1G" returned: 0 in 0.766s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:59 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c Jul 09 14:33:59 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:33:59 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] Created reservations ['f016c6c8-3056-4421-a15f-c5fc0b80007a', '076e6085-a2ec-4f84-b6d7-46ac8555fa6c', 'a2539329-6e02-4cc3-abe1-346fe661dbc6', '1c3939b5-5c56-4eff-9741-87c313487778'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:33:59 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] Delete snapshot completed successfully. Jul 09 14:33:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f4524e7b-1d1c-4f5e-b5e1-8a195e332d64 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-829f2c44-3419-4b8a-9bda-706fadabfdc3-delete_snapshot" released by "delete_snapshot" :: held 3.204s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:33:59 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 09 14:33:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c" returned: 0 in 0.674s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:33:59 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c is being set with open permissions: ugo+rw Jul 09 14:33:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:33:59 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c Jul 09 14:33:59 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:00 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-ce7a0990-babf-4b21-b37f-c595c1a495af-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:00 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] Lock "cinder-ce7a0990-babf-4b21-b37f-c595c1a495af-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:00 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-quobyte-ce7a0990-babf-4b21-b37f-c595c1a495af" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:00 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-ce7a0990-babf-4b21-b37f-c595c1a495af" acquired by "delete_volume" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:00 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[beebc070-4f8d-43b2-a857-e84e94a4934a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:00 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c" returned: 0 in 0.646s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:00 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af Jul 09 14:34:00 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:00 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.info Jul 09 14:34:00 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:01 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af" returned: 0 in 0.771s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:01 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.info" returned: 0 in 0.682s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:01 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.info is being set with open permissions: ugo+rw Jul 09 14:34:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:01 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af Jul 09 14:34:01 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:01 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.info Jul 09 14:34:01 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:01 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-ce7a0990-babf-4b21-b37f-c595c1a495af" returned: 0 in 0.642s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:01 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-ce7a0990-babf-4b21-b37f-c595c1a495af" released by "delete_volume" :: held 1.478s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:02 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.info" returned: 0 in 0.695s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.308s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:02 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] Created reservations ['4a4c3fb2-e473-498f-bab4-64c05515bd34', '83934011-46a1-4498-976d-e05f1ffc9abc', '4b0dea5e-1c57-4f54-bea7-645ab1191d76', '271f5707-4770-4f89-b33a-01556e97e5bf'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:34:02 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-36503fdc-2669-4523-82cc-5cbd5bb1160e tempest-ProjectMemberTests-1994606433 None] Create snapshot completed successfully Jul 09 14:34:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:02 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:34:02 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:34:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:02 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:34:02 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:02 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.645s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:02 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:34:02 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] Deleted volume successfully. Jul 09 14:34:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-cfca33eb-0b8c-4cc2-93af-bc0ecaf2732c tempest-ProjectReaderTests-1642326272 None] Lock "cinder-ce7a0990-babf-4b21-b37f-c595c1a495af-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-75dc9f59-80cb-4721-a28f-61e4a7a96d8c-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] Lock "cinder-75dc9f59-80cb-4721-a28f-61e4a7a96d8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-6d12302c-f832-4a4e-a1b1-258edc0ad5af" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-6d12302c-f832-4a4e-a1b1-258edc0ad5af" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-75dc9f59-80cb-4721-a28f-61e4a7a96d8c" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-75dc9f59-80cb-4721-a28f-61e4a7a96d8c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] Deleting offline snapshot 75dc9f59-80cb-4721-a28f-61e4a7a96d8c of volume 6d12302c-f832-4a4e-a1b1-258edc0ad5af {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] snapshot_file for this snap is: volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8c3105-b53b-45a1-9a44-1659658c9965]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Flow 'volume_create_manager' (36c010c0-6efd-4539-81ac-879742ce1929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:34:03 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c Jul 09 14:34:03 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d67d83-e7ec-47c8-9563-16fb166e2ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d67d83-e7ec-47c8-9563-16fb166e2ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1909830315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e171cd3-ba6a-42f9-ac2d-c3721b162f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a1aaefcb814102b9e44adbf90f0a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:34:03Z,use_quota=True,user_id='c6a8cf2ec91340b58f526a25ec672ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d3170d-3df2-4c56-8ebe-578dbf062229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d3170d-3df2-4c56-8ebe-578dbf062229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44df0d24-b018-4785-9520-cfc03abebd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44df0d24-b018-4785-9520-cfc03abebd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e171cd3-ba6a-42f9-ac2d-c3721b162f91', 'volume_name': 'volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf47c8e-43e8-4f2c-a70b-30217a9d5e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf47c8e-43e8-4f2c-a70b-30217a9d5e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad12ab3-be91-4c05-b38d-6fcc0438fd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:03 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Volume 6e171cd3-ba6a-42f9-ac2d-c3721b162f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91', 'volume_size': 1} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1909830315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e171cd3-ba6a-42f9-ac2d-c3721b162f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a1aaefcb814102b9e44adbf90f0a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:34:03Z,use_quota=True,user_id='c6a8cf2ec91340b58f526a25ec672ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Creating volume 6e171cd3-ba6a-42f9-ac2d-c3721b162f91 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:34:03 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:03 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91 1073741824 Jul 09 14:34:03 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:03 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c" returned: 0 in 0.789s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2d4812-a17d-46fc-b7ac-411c4d8b0eb6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:03 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af Jul 09 14:34:03 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:04 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91 1073741824" returned: 0 in 0.879s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:04 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91 Jul 09 14:34:04 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:04 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af" returned: 0 in 0.766s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:04 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c Jul 09 14:34:04 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:04 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91" returned: 0 in 0.649s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:34:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad12ab3-be91-4c05-b38d-6fcc0438fd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b342fe92-0f9b-4085-90ed-cdf6b36e182d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:04 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Volume volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91 (6e171cd3-ba6a-42f9-ac2d-c3721b162f91): created successfully Jul 09 14:34:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b342fe92-0f9b-4085-90ed-cdf6b36e182d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Flow 'volume_create_manager' (36c010c0-6efd-4539-81ac-879742ce1929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:34:04 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ab7f592e-9d63-432c-a793-9029d79587b6 tempest-ProjectReaderTests-1642326272 None] Created volume successfully. Jul 09 14:34:05 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c" returned: 0 in 0.762s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] Creating offline snapshot 4defa9c9-238d-4809-90c4-c2f431285fa3 of volume 6e171cd3-ba6a-42f9-ac2d-c3721b162f91 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:34:05 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c Jul 09 14:34:05 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:05 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1f11cb-6ef1-444a-866a-d48c342d654c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:05 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91 Jul 09 14:34:05 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:06 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af.75dc9f59-80cb-4721-a28f-61e4a7a96d8c" returned: 0 in 0.613s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:06 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-75dc9f59-80cb-4721-a28f-61e4a7a96d8c" released by "_delete_snapshot" :: held 3.027s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:06 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-6d12302c-f832-4a4e-a1b1-258edc0ad5af" released by "delete_snapshot" :: held 3.053s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:06 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] Created reservations ['a76d582a-549a-4809-b45e-05e4e1f5f989', 'bc7d39a9-f3c0-466d-a6fc-ad6737ac28b5', 'c1e02ffd-8c1b-4082-a4ca-e29cd68ab967', '0d2d5b73-14f8-40fd-ac0c-54f28aedd07e'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:34:06 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] Delete snapshot completed successfully. Jul 09 14:34:06 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-5940c542-8c73-4a68-9cec-8ce0306b1f0e tempest-ProjectMemberTests-1994606433 None] Lock "cinder-75dc9f59-80cb-4721-a28f-61e4a7a96d8c-delete_snapshot" released by "delete_snapshot" :: held 3.203s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:06 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91" returned: 0 in 0.822s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:06 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3 1G Jul 09 14:34:06 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:07 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3 1G" returned: 0 in 0.796s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:07 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3 Jul 09 14:34:07 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-6d12302c-f832-4a4e-a1b1-258edc0ad5af-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] Lock "cinder-6d12302c-f832-4a4e-a1b1-258edc0ad5af-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-6d12302c-f832-4a4e-a1b1-258edc0ad5af" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:07 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-6d12302c-f832-4a4e-a1b1-258edc0ad5af" acquired by "delete_volume" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:07 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aec8bc5-0f9b-410f-b304-5fd6c8640fc5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:07 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af Jul 09 14:34:07 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:07 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3" returned: 0 in 0.742s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:07 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3 is being set with open permissions: ugo+rw Jul 09 14:34:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:07 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3 Jul 09 14:34:07 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:08 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af" returned: 0 in 0.763s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:08 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af Jul 09 14:34:08 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:08 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3" returned: 0 in 0.643s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:08 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.info Jul 09 14:34:08 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:08 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6d12302c-f832-4a4e-a1b1-258edc0ad5af" returned: 0 in 0.690s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:08 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-6d12302c-f832-4a4e-a1b1-258edc0ad5af" released by "delete_volume" :: held 1.522s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:08 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] Created reservations ['a31a6625-978d-4dab-9750-3eee726b657e', '2533be13-a07a-48b8-8ed4-a52baeb18946', '44b1a661-05aa-4016-b862-22e3779a373f', '7d5ebcb9-0904-4f42-925f-5c248c4299dc'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:34:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:34:08 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:34:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:08 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:34:08 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:09 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.info" returned: 0 in 0.690s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:09 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.info is being set with open permissions: ugo+rw Jul 09 14:34:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:09 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.info Jul 09 14:34:09 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:09 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.653s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:09 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:34:09 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] Deleted volume successfully. Jul 09 14:34:09 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-98693a21-846f-486a-a752-2a6d19eb23bc tempest-ProjectMemberTests-1994606433 None] Lock "cinder-6d12302c-f832-4a4e-a1b1-258edc0ad5af-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:09 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.info" returned: 0 in 0.724s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.540s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:09 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-a8ffba9f-b46a-4913-81b4-659e9fbe8028 tempest-ProjectReaderTests-1642326272 None] Create snapshot completed successfully Jul 09 14:34:09 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Flow 'volume_create_manager' (df533d95-1fd2-42b2-ac45-b5a773c1d47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fae529-b9b8-4323-86e3-cfb3315edf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fae529-b9b8-4323-86e3-cfb3315edf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1807238311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c557ba84-6567-4340-b713-fe0592df644f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bba6e5fbe534bdf9f3e3459b1cd2d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:34:10Z,use_quota=True,user_id='d1e928af629b46fab523964aa23893c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bf37fb-adf6-4fda-8075-e1354c2d26aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bf37fb-adf6-4fda-8075-e1354c2d26aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be7e9592-a75c-4603-b9dc-af42dc0130ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be7e9592-a75c-4603-b9dc-af42dc0130ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c557ba84-6567-4340-b713-fe0592df644f', 'volume_name': 'volume-c557ba84-6567-4340-b713-fe0592df644f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf3c82d-cd96-4cb4-8cf4-678267413fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf3c82d-cd96-4cb4-8cf4-678267413fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a76311-568d-4063-a8b8-817692d8d42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:10 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Volume c557ba84-6567-4340-b713-fe0592df644f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c557ba84-6567-4340-b713-fe0592df644f', 'volume_size': 1} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1807238311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c557ba84-6567-4340-b713-fe0592df644f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bba6e5fbe534bdf9f3e3459b1cd2d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:34:10Z,use_quota=True,user_id='d1e928af629b46fab523964aa23893c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Creating volume c557ba84-6567-4340-b713-fe0592df644f {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:34:10 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:10 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f 1073741824 Jul 09 14:34:10 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-4defa9c9-238d-4809-90c4-c2f431285fa3-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-4defa9c9-238d-4809-90c4-c2f431285fa3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-quobyte-6e171cd3-ba6a-42f9-ac2d-c3721b162f91" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-6e171cd3-ba6a-42f9-ac2d-c3721b162f91" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-quobyte-4defa9c9-238d-4809-90c4-c2f431285fa3" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-4defa9c9-238d-4809-90c4-c2f431285fa3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] Deleting offline snapshot 4defa9c9-238d-4809-90c4-c2f431285fa3 of volume 6e171cd3-ba6a-42f9-ac2d-c3721b162f91 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] snapshot_file for this snap is: volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afdddaa-25e0-46f1-b4cc-74aeedbb5ef2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:10 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3 Jul 09 14:34:10 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:11 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f 1073741824" returned: 0 in 0.930s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:11 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f Jul 09 14:34:11 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:11 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3" returned: 0 in 0.790s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:11 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:34:11 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f56bda-4c3d-4a93-b5bf-11fc7a79625c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:11 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91 Jul 09 14:34:11 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:11 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f" returned: 0 in 0.659s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:11 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:34:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a76311-568d-4063-a8b8-817692d8d42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c557ba84-6567-4340-b713-fe0592df644f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7355b3ab-f245-4266-b9d3-c75ea45f35d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:11 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Volume volume-c557ba84-6567-4340-b713-fe0592df644f (c557ba84-6567-4340-b713-fe0592df644f): created successfully Jul 09 14:34:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7355b3ab-f245-4266-b9d3-c75ea45f35d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:11 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Flow 'volume_create_manager' (df533d95-1fd2-42b2-ac45-b5a773c1d47d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:34:11 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-4b5a2dcf-53f1-466a-b702-4144b852e936 tempest-ProjectMemberTests-1994606433 None] Created volume successfully. Jul 09 14:34:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] Creating offline snapshot 376aa674-8f58-4e89-af5f-1df04b0f9f68 of volume c557ba84-6567-4340-b713-fe0592df644f {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:34:12 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4c992d-0dca-49a0-839d-16c3f4a49b69]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:12 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f Jul 09 14:34:12 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:12 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91" returned: 0 in 0.801s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:12 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3 Jul 09 14:34:12 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:34:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:34:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:34:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:12 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:34:12 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:13 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f" returned: 0 in 0.778s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:13 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68 1G Jul 09 14:34:13 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:13 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3" returned: 0 in 0.843s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:13 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3 Jul 09 14:34:13 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:13 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.682s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:34:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:34:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:34:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:34:13 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68 1G" returned: 0 in 0.883s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c557ba84-6567-4340-b713-fe0592df644f -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:13 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:13 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c557ba84-6567-4340-b713-fe0592df644f -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68 Jul 09 14:34:13 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91.4defa9c9-238d-4809-90c4-c2f431285fa3" returned: 0 in 0.708s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-4defa9c9-238d-4809-90c4-c2f431285fa3" released by "_delete_snapshot" :: held 3.238s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-6e171cd3-ba6a-42f9-ac2d-c3721b162f91" released by "delete_snapshot" :: held 3.266s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:14 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] Created reservations ['b8b52555-1630-4b4e-81b9-077434b7ad33', 'cc1ec6b2-da3f-40af-8586-4fdf55ddbce6', 'aa23026f-8c18-4fb9-a2a5-f7165194f8d7', 'fec67e93-78db-43a8-96bf-c3f2a145f8fe'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:34:14 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] Delete snapshot completed successfully. Jul 09 14:34:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-261060f3-8ab3-439c-a70b-e5c151439c64 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-4defa9c9-238d-4809-90c4-c2f431285fa3-delete_snapshot" released by "delete_snapshot" :: held 3.414s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:14 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c557ba84-6567-4340-b713-fe0592df644f -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68" returned: 0 in 0.684s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:14 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68 is being set with open permissions: ugo+rw Jul 09 14:34:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:14 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68 Jul 09 14:34:14 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-6e171cd3-ba6a-42f9-ac2d-c3721b162f91-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-6e171cd3-ba6a-42f9-ac2d-c3721b162f91-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-quobyte-6e171cd3-ba6a-42f9-ac2d-c3721b162f91" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:14 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-6e171cd3-ba6a-42f9-ac2d-c3721b162f91" acquired by "delete_volume" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:15 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f89995a-e37f-4666-8e5c-981b9f65b79a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:15 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91 Jul 09 14:34:15 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:15 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68" returned: 0 in 0.676s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:15 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.info Jul 09 14:34:15 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:15 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91" returned: 0 in 0.797s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:15 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91 Jul 09 14:34:15 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:15 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.info" returned: 0 in 0.647s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:15 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.info is being set with open permissions: ugo+rw Jul 09 14:34:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:15 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.info Jul 09 14:34:15 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:16 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-6e171cd3-ba6a-42f9-ac2d-c3721b162f91" returned: 0 in 0.719s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-6e171cd3-ba6a-42f9-ac2d-c3721b162f91" released by "delete_volume" :: held 1.589s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:16 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.info" returned: 0 in 0.680s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.434s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:16 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-94a6919e-8d98-4cd3-a8dc-38038a5adb91 tempest-ProjectMemberTests-1994606433 None] Create snapshot completed successfully Jul 09 14:34:16 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] Created reservations ['96ac8647-433e-4750-b223-a2e7cf726d98', '59de75e7-e588-4b22-b6bb-88ab25e057e8', 'c540f059-a587-46ae-bfd5-2b0155cd1246', '4eba297e-9ad9-442e-b6c1-64b3e68589bb'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:34:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:34:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:34:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:16 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:34:16 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:17 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.672s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:34:17 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] Deleted volume successfully. Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-71705e9a-4341-4012-832f-6e92b9debce9 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-6e171cd3-ba6a-42f9-ac2d-c3721b162f91-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-376aa674-8f58-4e89-af5f-1df04b0f9f68-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-376aa674-8f58-4e89-af5f-1df04b0f9f68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-c557ba84-6567-4340-b713-fe0592df644f" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-c557ba84-6567-4340-b713-fe0592df644f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-376aa674-8f58-4e89-af5f-1df04b0f9f68" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-376aa674-8f58-4e89-af5f-1df04b0f9f68" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] Deleting offline snapshot 376aa674-8f58-4e89-af5f-1df04b0f9f68 of volume c557ba84-6567-4340-b713-fe0592df644f {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] snapshot_file for this snap is: volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[1532b4b8-b4b9-4a71-a517-e299c3245a9f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Flow 'volume_create_manager' (57104ad9-2e8b-46c7-9ca9-8d1e946d954c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e42a1ef-a9cf-48cc-9d80-9df044ddc34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:17 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68 Jul 09 14:34:17 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e42a1ef-a9cf-48cc-9d80-9df044ddc34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-108109828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c049fba-086d-4eca-a17f-a6cf73c82fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a1aaefcb814102b9e44adbf90f0a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:34:18Z,use_quota=True,user_id='c6a8cf2ec91340b58f526a25ec672ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6699d21f-990e-4d9d-bd2e-62c4b303bc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6699d21f-990e-4d9d-bd2e-62c4b303bc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572b02bf-e166-47cb-8266-bcf7cf06ee05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572b02bf-e166-47cb-8266-bcf7cf06ee05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c049fba-086d-4eca-a17f-a6cf73c82fbe', 'volume_name': 'volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adde3ff1-d119-4e62-869e-903f76dac506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adde3ff1-d119-4e62-869e-903f76dac506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75890819-070b-42d2-82ee-597ed1f523e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:17 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Volume 3c049fba-086d-4eca-a17f-a6cf73c82fbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe', 'volume_size': 1} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-108109828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c049fba-086d-4eca-a17f-a6cf73c82fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a1aaefcb814102b9e44adbf90f0a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:34:18Z,use_quota=True,user_id='c6a8cf2ec91340b58f526a25ec672ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Creating volume 3c049fba-086d-4eca-a17f-a6cf73c82fbe {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:34:17 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:34:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:17 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe 1073741824 Jul 09 14:34:17 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:18 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68" returned: 0 in 0.822s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:18 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c557ba84-6567-4340-b713-fe0592df644f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:34:18 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[076700ba-747c-4d38-b3cd-9f8a572faa3a]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:18 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f Jul 09 14:34:18 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:18 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe 1073741824" returned: 0 in 0.823s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:18 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe Jul 09 14:34:18 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:19 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f" returned: 0 in 0.812s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:19 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68 Jul 09 14:34:19 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:19 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe" returned: 0 in 0.675s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:34:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75890819-070b-42d2-82ee-597ed1f523e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e96d9c-691f-4b0e-b26b-ebb8ab27e3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:19 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Volume volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe (3c049fba-086d-4eca-a17f-a6cf73c82fbe): created successfully Jul 09 14:34:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e96d9c-691f-4b0e-b26b-ebb8ab27e3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:19 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Flow 'volume_create_manager' (57104ad9-2e8b-46c7-9ca9-8d1e946d954c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:34:19 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-d0f07bca-cc42-4ac9-915f-507c99b9b291 tempest-ProjectReaderTests-1642326272 None] Created volume successfully. Jul 09 14:34:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] Creating offline snapshot 20cc87b5-5fff-431e-a846-e6a7f91b0fae of volume 3c049fba-086d-4eca-a17f-a6cf73c82fbe {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:34:19 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d000aa-8f42-4d0c-b5bc-6ce5b7fd0618]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:20 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe Jul 09 14:34:20 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:20 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68" returned: 0 in 0.807s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:20 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68 Jul 09 14:34:20 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:20 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f.376aa674-8f58-4e89-af5f-1df04b0f9f68" returned: 0 in 0.658s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:20 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe" returned: 0 in 0.804s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:20 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-376aa674-8f58-4e89-af5f-1df04b0f9f68" released by "_delete_snapshot" :: held 3.215s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:20 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-c557ba84-6567-4340-b713-fe0592df644f" released by "delete_snapshot" :: held 3.245s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:20 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae 1G Jul 09 14:34:20 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:20 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] Created reservations ['f73c14cd-400c-4f66-8c0a-04dcf3507862', '185a9dd4-5f51-44d5-bed8-031e9de07b90', 'ef6db7f3-b932-4e15-9cb7-9b14470445e0', 'dfc716c5-db4b-4d96-b71b-1cc0b1811559'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:34:20 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] Delete snapshot completed successfully. Jul 09 14:34:20 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-52810a44-293c-47ef-94e0-208fd7812a50 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-376aa674-8f58-4e89-af5f-1df04b0f9f68-delete_snapshot" released by "delete_snapshot" :: held 3.389s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:21 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae 1G" returned: 0 in 0.787s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:21 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae Jul 09 14:34:21 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-c557ba84-6567-4340-b713-fe0592df644f-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-c557ba84-6567-4340-b713-fe0592df644f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-c557ba84-6567-4340-b713-fe0592df644f" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-c557ba84-6567-4340-b713-fe0592df644f" acquired by "delete_volume" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:21 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34052c2-7995-46a0-89f0-0c119d96d927]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:21 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f Jul 09 14:34:21 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:22 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae" returned: 0 in 0.696s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:22 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae is being set with open permissions: ugo+rw Jul 09 14:34:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:22 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae Jul 09 14:34:22 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:22 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f" returned: 0 in 0.743s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:22 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f Jul 09 14:34:22 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:22 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae" returned: 0 in 0.654s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:22 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.info Jul 09 14:34:22 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:23 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-c557ba84-6567-4340-b713-fe0592df644f" returned: 0 in 0.631s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:23 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-c557ba84-6567-4340-b713-fe0592df644f" released by "delete_volume" :: held 1.462s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:23 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] Created reservations ['b98010d6-206b-49e2-8a0e-d9a38492ed8c', 'd105a524-5a53-4e94-ad10-c5af9f4ed913', 'ceb8a1b9-192f-4798-b864-d7d756e64d64', '42e7215a-d71c-460e-a071-14a28bbdb1c5'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:34:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:34:23 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:34:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:23 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:34:23 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:23 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.info" returned: 0 in 0.658s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:23 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.info is being set with open permissions: ugo+rw Jul 09 14:34:23 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:23 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.info Jul 09 14:34:23 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:24 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.653s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:34:24 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] Deleted volume successfully. Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-de4b46ac-2b50-45cb-bc63-871119980314 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-c557ba84-6567-4340-b713-fe0592df644f-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:24 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.info" returned: 0 in 0.638s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.322s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:24 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c083f804-2fac-4b93-98fb-bf14f131890d tempest-ProjectReaderTests-1642326272 None] Create snapshot completed successfully Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Flow 'volume_create_manager' (5297684d-bf03-49ea-925f-e60ec7dc2487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a5e751-c8f2-42f6-94c2-182422b93733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a5e751-c8f2-42f6-94c2-182422b93733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-567502523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59cf9fcd-6e4b-4626-943e-19d5a186800d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bba6e5fbe534bdf9f3e3459b1cd2d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:34:24Z,use_quota=True,user_id='d1e928af629b46fab523964aa23893c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36011cb-85ef-4dd8-9d26-8ec1b5164b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36011cb-85ef-4dd8-9d26-8ec1b5164b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d16d50-5637-4c6b-91de-e6f8d42bf20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d16d50-5637-4c6b-91de-e6f8d42bf20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59cf9fcd-6e4b-4626-943e-19d5a186800d', 'volume_name': 'volume-59cf9fcd-6e4b-4626-943e-19d5a186800d', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5112e288-05b0-4cb9-af76-b5ef3c867b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5112e288-05b0-4cb9-af76-b5ef3c867b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5249e9-d930-4437-bed0-e69152e1f95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:24 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Volume 59cf9fcd-6e4b-4626-943e-19d5a186800d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59cf9fcd-6e4b-4626-943e-19d5a186800d', 'volume_size': 1} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-567502523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59cf9fcd-6e4b-4626-943e-19d5a186800d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bba6e5fbe534bdf9f3e3459b1cd2d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:34:24Z,use_quota=True,user_id='d1e928af629b46fab523964aa23893c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Creating volume 59cf9fcd-6e4b-4626-943e-19d5a186800d {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:34:24 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:34:24 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:24 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d 1073741824 Jul 09 14:34:24 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:25 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-20cc87b5-5fff-431e-a846-e6a7f91b0fae-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:25 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-20cc87b5-5fff-431e-a846-e6a7f91b0fae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:25 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-quobyte-3c049fba-086d-4eca-a17f-a6cf73c82fbe" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:25 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-3c049fba-086d-4eca-a17f-a6cf73c82fbe" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:25 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-quobyte-20cc87b5-5fff-431e-a846-e6a7f91b0fae" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:25 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-20cc87b5-5fff-431e-a846-e6a7f91b0fae" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] Deleting offline snapshot 20cc87b5-5fff-431e-a846-e6a7f91b0fae of volume 3c049fba-086d-4eca-a17f-a6cf73c82fbe {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:34:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] snapshot_file for this snap is: volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:34:25 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe6c9f5-ff93-4eaa-963c-2bfe735f41e0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:25 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae Jul 09 14:34:25 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:25 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d 1073741824" returned: 0 in 0.848s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:25 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d Jul 09 14:34:25 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:25 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae" returned: 0 in 0.740s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:25 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:34:25 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[3baf80ee-993d-4da0-b3b3-383a47085459]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:25 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:26 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d" returned: 0 in 0.658s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:34:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5249e9-d930-4437-bed0-e69152e1f95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59cf9fcd-6e4b-4626-943e-19d5a186800d', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beed6463-8430-45d9-a43f-1bb7d1e01eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:26 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Volume volume-59cf9fcd-6e4b-4626-943e-19d5a186800d (59cf9fcd-6e4b-4626-943e-19d5a186800d): created successfully Jul 09 14:34:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beed6463-8430-45d9-a43f-1bb7d1e01eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:26 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Flow 'volume_create_manager' (5297684d-bf03-49ea-925f-e60ec7dc2487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:34:26 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe Jul 09 14:34:26 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:26 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-983bdef5-37bd-4af0-a19a-1f818d7cc861 tempest-ProjectMemberTests-1994606433 None] Created volume successfully. Jul 09 14:34:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:26 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] Creating offline snapshot 97e7e204-76a8-48be-8131-b533b3a48e82 of volume 59cf9fcd-6e4b-4626-943e-19d5a186800d {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:34:26 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fe2424-8ed8-465e-b95b-d6162896d135]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:26 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe" returned: 0 in 0.743s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:26 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:26 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae Jul 09 14:34:26 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:26 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d Jul 09 14:34:26 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:27 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d" returned: 0 in 0.753s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:27 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82 1G Jul 09 14:34:27 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:27 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae" returned: 0 in 0.767s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:27 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:27 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae Jul 09 14:34:27 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:28 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe.20cc87b5-5fff-431e-a846-e6a7f91b0fae" returned: 0 in 0.679s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:28 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-20cc87b5-5fff-431e-a846-e6a7f91b0fae" released by "_delete_snapshot" :: held 3.025s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:28 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-3c049fba-086d-4eca-a17f-a6cf73c82fbe" released by "delete_snapshot" :: held 3.053s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:28 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82 1G" returned: 0 in 0.825s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59cf9fcd-6e4b-4626-943e-19d5a186800d -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:28 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59cf9fcd-6e4b-4626-943e-19d5a186800d -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82 Jul 09 14:34:28 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:28 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] Created reservations ['4c81b513-473f-4cef-b3da-7ee72127066a', 'e969ef3b-d3ef-4066-be71-6b69ba6d84e4', 'f00e607c-79b2-4375-a271-dd324484b058', 'af4710e8-961b-45d7-be80-049794e67a98'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:34:28 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] Delete snapshot completed successfully. Jul 09 14:34:28 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-2389cd83-72f4-42ff-802d-b4da24fd5592 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-20cc87b5-5fff-431e-a846-e6a7f91b0fae-delete_snapshot" released by "delete_snapshot" :: held 3.223s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:28 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59cf9fcd-6e4b-4626-943e-19d5a186800d -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82" returned: 0 in 0.731s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:28 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82 is being set with open permissions: ugo+rw Jul 09 14:34:28 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:29 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82 Jul 09 14:34:29 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-3c049fba-086d-4eca-a17f-a6cf73c82fbe-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-3c049fba-086d-4eca-a17f-a6cf73c82fbe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "cinder-quobyte-3c049fba-086d-4eca-a17f-a6cf73c82fbe" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:29 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-3c049fba-086d-4eca-a17f-a6cf73c82fbe" acquired by "delete_volume" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:29 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[249c5158-586b-4695-8891-dc8ed77d76c3]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:29 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe Jul 09 14:34:29 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:29 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82" returned: 0 in 0.641s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:29 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:29 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.info Jul 09 14:34:29 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:30 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe" returned: 0 in 0.760s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:30 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe Jul 09 14:34:30 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:30 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.info" returned: 0 in 0.665s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:30 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.info is being set with open permissions: ugo+rw Jul 09 14:34:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:30 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.info Jul 09 14:34:30 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:30 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3c049fba-086d-4eca-a17f-a6cf73c82fbe" returned: 0 in 0.663s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:30 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-quobyte-3c049fba-086d-4eca-a17f-a6cf73c82fbe" released by "delete_volume" :: held 1.484s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:30 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:30 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.info" returned: 0 in 0.665s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.367s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] Created reservations ['a4192c93-26eb-483e-be38-1967500aea5a', 'f1a88172-ac71-4265-8ef3-7a6582ee1d95', '5005e347-9e83-47b8-afba-654a28bd2375', 'd96b662e-a2d4-4e3b-b6b4-63e132821601'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:34:31 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-375b7f59-44c1-408e-af67-b6ab6e3bffdf tempest-ProjectMemberTests-1994606433 None] Create snapshot completed successfully Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:31 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:34:31 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:31 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.647s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:34:31 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] Deleted volume successfully. Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-62b802c5-4246-4a08-8450-acf4d9648cf6 tempest-ProjectReaderTests-1642326272 None] Lock "cinder-3c049fba-086d-4eca-a17f-a6cf73c82fbe-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-97e7e204-76a8-48be-8131-b533b3a48e82-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] Lock "cinder-97e7e204-76a8-48be-8131-b533b3a48e82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-59cf9fcd-6e4b-4626-943e-19d5a186800d" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-59cf9fcd-6e4b-4626-943e-19d5a186800d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-97e7e204-76a8-48be-8131-b533b3a48e82" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-97e7e204-76a8-48be-8131-b533b3a48e82" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] Deleting offline snapshot 97e7e204-76a8-48be-8131-b533b3a48e82 of volume 59cf9fcd-6e4b-4626-943e-19d5a186800d {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] snapshot_file for this snap is: volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fba7c5a-6ef8-43c2-9354-439baf62c29c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:31 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:32 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82 Jul 09 14:34:32 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:32 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82" returned: 0 in 0.809s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:32 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59cf9fcd-6e4b-4626-943e-19d5a186800d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:34:32 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f9327a-8d77-46a3-9aeb-3154ef4945d4]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:32 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:32 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d Jul 09 14:34:32 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:33 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d" returned: 0 in 0.790s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:33 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:33 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82 Jul 09 14:34:33 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:34 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82" returned: 0 in 0.764s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:34 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:34 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82 Jul 09 14:34:34 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:35 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d.97e7e204-76a8-48be-8131-b533b3a48e82" returned: 0 in 0.668s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-97e7e204-76a8-48be-8131-b533b3a48e82" released by "_delete_snapshot" :: held 3.130s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-59cf9fcd-6e4b-4626-943e-19d5a186800d" released by "delete_snapshot" :: held 3.150s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=107,cinder:UPDATE=147,cinder:INSERT=42,cinder:DELETE=8 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=125,cinder:UPDATE=150,cinder:INSERT=41,cinder:DELETE=17 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] Created reservations ['a12f7880-bc53-4f9f-b9b7-dbc9277bb710', 'c0894c37-79f7-4e38-88c5-8fd7a2d2779d', '800d8ce0-b5cb-481e-bc1a-ca6b3c173641', '119666e8-2779-4b39-ad60-03cd8e3d7f74'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:34:35 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] Delete snapshot completed successfully. Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-52736c1a-63da-4dcd-8a0a-9e77c4e3257c tempest-ProjectMemberTests-1994606433 None] Lock "cinder-97e7e204-76a8-48be-8131-b533b3a48e82-delete_snapshot" released by "delete_snapshot" :: held 3.286s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Flow 'volume_create_manager' (bf96567e-c1c7-4409-b90a-53f1ff48bbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4148d503-aa76-4bd3-a35e-cb064fa4154c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4148d503-aa76-4bd3-a35e-cb064fa4154c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-529000676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0053503c-9ca6-43ee-8d2b-25fee2c7372d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea15a2f0622444b88ea941a9b972906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:34:35Z,use_quota=True,user_id='899a756b23d644ed8c97900c3b2cf4b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11739c5f-5dec-4f52-aa2b-e9c5872633d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11739c5f-5dec-4f52-aa2b-e9c5872633d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99fb88d8-5705-48af-a3b2-3c0db5bba758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99fb88d8-5705-48af-a3b2-3c0db5bba758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0053503c-9ca6-43ee-8d2b-25fee2c7372d', 'volume_name': 'volume-0053503c-9ca6-43ee-8d2b-25fee2c7372d', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1034e968-b9f5-49c0-9e50-338a12f352e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1034e968-b9f5-49c0-9e50-338a12f352e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a76653a3-f53f-4c85-b96b-6f02503f2fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:35 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Volume 0053503c-9ca6-43ee-8d2b-25fee2c7372d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0053503c-9ca6-43ee-8d2b-25fee2c7372d', 'volume_size': 1} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-529000676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0053503c-9ca6-43ee-8d2b-25fee2c7372d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea15a2f0622444b88ea941a9b972906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:34:35Z,use_quota=True,user_id='899a756b23d644ed8c97900c3b2cf4b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Creating volume 0053503c-9ca6-43ee-8d2b-25fee2c7372d {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:34:35 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:34:35 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0053503c-9ca6-43ee-8d2b-25fee2c7372d 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:35 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0053503c-9ca6-43ee-8d2b-25fee2c7372d 1073741824 Jul 09 14:34:35 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-59cf9fcd-6e4b-4626-943e-19d5a186800d-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-59cf9fcd-6e4b-4626-943e-19d5a186800d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-59cf9fcd-6e4b-4626-943e-19d5a186800d" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:36 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-59cf9fcd-6e4b-4626-943e-19d5a186800d" acquired by "delete_volume" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:36 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[9638a8a6-c7b2-446c-ba1c-ac94bbadd0bf]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:36 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d Jul 09 14:34:36 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:36 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0053503c-9ca6-43ee-8d2b-25fee2c7372d 1073741824" returned: 0 in 0.815s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0053503c-9ca6-43ee-8d2b-25fee2c7372d {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:36 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0053503c-9ca6-43ee-8d2b-25fee2c7372d Jul 09 14:34:36 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:36 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d" returned: 0 in 0.759s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:36 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:37 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d Jul 09 14:34:37 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:37 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0053503c-9ca6-43ee-8d2b-25fee2c7372d" returned: 0 in 0.655s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a76653a3-f53f-4c85-b96b-6f02503f2fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0053503c-9ca6-43ee-8d2b-25fee2c7372d', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b42a91-b76e-4ee1-9f35-f8690da3ef41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:37 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Volume volume-0053503c-9ca6-43ee-8d2b-25fee2c7372d (0053503c-9ca6-43ee-8d2b-25fee2c7372d): created successfully Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b42a91-b76e-4ee1-9f35-f8690da3ef41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Flow 'volume_create_manager' (bf96567e-c1c7-4409-b90a-53f1ff48bbd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:34:37 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-4e19bbef-fd14-494a-819c-22fb3c464cfc tempest-ProjectReaderTests-1319788490 None] Created volume successfully. Jul 09 14:34:37 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-59cf9fcd-6e4b-4626-943e-19d5a186800d" returned: 0 in 0.618s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-59cf9fcd-6e4b-4626-943e-19d5a186800d" released by "delete_volume" :: held 1.432s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] Created reservations ['8165ad5f-1855-47de-8b66-b1f6671f6845', '9d88f208-2651-44df-af9b-f803cdb29ff7', 'a3e911ee-0d7e-4336-b2e9-360871884213', '6da2bc26-7de4-43a5-8f01-1e91848c6279'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:37 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:34:37 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] Acquiring lock "cinder-0053503c-9ca6-43ee-8d2b-25fee2c7372d-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] Lock "cinder-0053503c-9ca6-43ee-8d2b-25fee2c7372d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] Acquiring lock "cinder-quobyte-0053503c-9ca6-43ee-8d2b-25fee2c7372d" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] Lock "cinder-quobyte-0053503c-9ca6-43ee-8d2b-25fee2c7372d" acquired by "delete_volume" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e438f49-445d-4970-939e-359dacc1b1bc]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:37 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0053503c-9ca6-43ee-8d2b-25fee2c7372d {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:38 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0053503c-9ca6-43ee-8d2b-25fee2c7372d Jul 09 14:34:38 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:38 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.665s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:34:38 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] Deleted volume successfully. Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-b321ce3f-1f13-413a-b4a1-247ad58976a2 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-59cf9fcd-6e4b-4626-943e-19d5a186800d-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:38 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0053503c-9ca6-43ee-8d2b-25fee2c7372d" returned: 0 in 0.785s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0053503c-9ca6-43ee-8d2b-25fee2c7372d {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:38 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0053503c-9ca6-43ee-8d2b-25fee2c7372d Jul 09 14:34:38 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Flow 'volume_create_manager' (e45c1cb5-43d9-4e89-adb7-302e24a22152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5a402a-7bd6-4b50-ac0a-b8ad5234deba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5a402a-7bd6-4b50-ac0a-b8ad5234deba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1642062126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d35b4d03-8113-4c08-99d7-6cd91d22f6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bba6e5fbe534bdf9f3e3459b1cd2d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:34:39Z,use_quota=True,user_id='d1e928af629b46fab523964aa23893c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f852b4cd-de3c-4a09-b7f9-fef826a57123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f852b4cd-de3c-4a09-b7f9-fef826a57123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c54899-d174-423b-894e-d5bdc1ddc282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c54899-d174-423b-894e-d5bdc1ddc282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd35b4d03-8113-4c08-99d7-6cd91d22f6cb', 'volume_name': 'volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9f316a-b444-4475-8b02-ede192eda54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9f316a-b444-4475-8b02-ede192eda54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe3b4ba-4842-47f1-814a-b79124373815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:38 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Volume d35b4d03-8113-4c08-99d7-6cd91d22f6cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb', 'volume_size': 1} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1642062126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d35b4d03-8113-4c08-99d7-6cd91d22f6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bba6e5fbe534bdf9f3e3459b1cd2d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:34:39Z,use_quota=True,user_id='d1e928af629b46fab523964aa23893c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Creating volume d35b4d03-8113-4c08-99d7-6cd91d22f6cb {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:34:38 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:34:38 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:38 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb 1073741824 Jul 09 14:34:38 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:39 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-0053503c-9ca6-43ee-8d2b-25fee2c7372d" returned: 0 in 0.643s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:39 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] Lock "cinder-quobyte-0053503c-9ca6-43ee-8d2b-25fee2c7372d" released by "delete_volume" :: held 1.469s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:39 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] Created reservations ['b8cb1265-27db-43c2-a8fc-7498110813e9', 'eecf4d78-ce51-4930-8f59-0ccbfb57f9ee', 'e98d0777-77b1-4228-8a87-fd9413e88231', '86a3aa60-ed6c-429d-8802-db9a13e2b800'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:34:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:34:39 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:34:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:39 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:34:39 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:39 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb 1073741824" returned: 0 in 0.815s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:39 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:39 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb Jul 09 14:34:39 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:40 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.639s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:34:40 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] Deleted volume successfully. Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-68323322-ab44-4017-8f04-f516bec2be13 tempest-ProjectReaderTests-1319788490 None] Lock "cinder-0053503c-9ca6-43ee-8d2b-25fee2c7372d-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:40 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb" returned: 0 in 0.649s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe3b4ba-4842-47f1-814a-b79124373815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4831d517-f904-46d7-a9bf-9519587ac3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:40 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Volume volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb (d35b4d03-8113-4c08-99d7-6cd91d22f6cb): created successfully Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4831d517-f904-46d7-a9bf-9519587ac3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Flow 'volume_create_manager' (e45c1cb5-43d9-4e89-adb7-302e24a22152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Flow 'volume_create_manager' (9188bcb7-742a-4935-a6ea-ec6f1b0e9ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f050ae4b-2184-4675-a393-0b35861174d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:40 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9b890cf6-d7ca-4d73-b1b4-d96e529ddd02 tempest-ProjectMemberTests-1994606433 None] Created volume successfully. Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f050ae4b-2184-4675-a393-0b35861174d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1858196421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48332640-9ea9-4163-a94b-c46b6d06afb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea15a2f0622444b88ea941a9b972906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:34:40Z,use_quota=True,user_id='899a756b23d644ed8c97900c3b2cf4b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68cceea-f6a3-4d1f-aef2-c258b677e201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68cceea-f6a3-4d1f-aef2-c258b677e201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59c0885-d260-43ed-a7d0-80719f42923f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59c0885-d260-43ed-a7d0-80719f42923f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48332640-9ea9-4163-a94b-c46b6d06afb2', 'volume_name': 'volume-48332640-9ea9-4163-a94b-c46b6d06afb2', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (210f7396-098b-47f9-8b76-63529c825799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (210f7396-098b-47f9-8b76-63529c825799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45855e6-320f-4f21-930e-038998525dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:40 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Volume 48332640-9ea9-4163-a94b-c46b6d06afb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48332640-9ea9-4163-a94b-c46b6d06afb2', 'volume_size': 1} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1858196421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48332640-9ea9-4163-a94b-c46b6d06afb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea15a2f0622444b88ea941a9b972906a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:34:40Z,use_quota=True,user_id='899a756b23d644ed8c97900c3b2cf4b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Creating volume 48332640-9ea9-4163-a94b-c46b6d06afb2 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:34:40 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:34:40 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-48332640-9ea9-4163-a94b-c46b6d06afb2 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:40 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-48332640-9ea9-4163-a94b-c46b6d06afb2 1073741824 Jul 09 14:34:40 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:41 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-48332640-9ea9-4163-a94b-c46b6d06afb2 1073741824" returned: 0 in 0.785s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:41 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-48332640-9ea9-4163-a94b-c46b6d06afb2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:41 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-48332640-9ea9-4163-a94b-c46b6d06afb2 Jul 09 14:34:41 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:42 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-48332640-9ea9-4163-a94b-c46b6d06afb2" returned: 0 in 0.627s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.981s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b45855e6-320f-4f21-930e-038998525dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48332640-9ea9-4163-a94b-c46b6d06afb2', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628eec5f-cfd0-4613-8367-f71f0ad77355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] Creating offline snapshot 11452a7c-d5b1-47e4-8293-59936887eb84 of volume d35b4d03-8113-4c08-99d7-6cd91d22f6cb {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:34:42 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Volume volume-48332640-9ea9-4163-a94b-c46b6d06afb2 (48332640-9ea9-4163-a94b-c46b6d06afb2): created successfully Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628eec5f-cfd0-4613-8367-f71f0ad77355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Flow 'volume_create_manager' (9188bcb7-742a-4935-a6ea-ec6f1b0e9ce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b510e36-ab85-493f-b7b1-6653260da0a5]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:42 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-e89b3df3-246f-42cd-973e-46ab68fa4289 tempest-ProjectReaderTests-1319788490 None] Created volume successfully. Jul 09 14:34:42 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb Jul 09 14:34:42 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] Acquiring lock "cinder-48332640-9ea9-4163-a94b-c46b6d06afb2-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] Lock "cinder-48332640-9ea9-4163-a94b-c46b6d06afb2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] Acquiring lock "cinder-quobyte-48332640-9ea9-4163-a94b-c46b6d06afb2" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] Lock "cinder-quobyte-48332640-9ea9-4163-a94b-c46b6d06afb2" acquired by "delete_volume" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8960be-1449-4d50-beb2-4fa684300be1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-48332640-9ea9-4163-a94b-c46b6d06afb2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:42 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-48332640-9ea9-4163-a94b-c46b6d06afb2 Jul 09 14:34:42 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:42 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb" returned: 0 in 0.764s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:42 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:42 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84 1G Jul 09 14:34:42 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:43 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-48332640-9ea9-4163-a94b-c46b6d06afb2" returned: 0 in 0.873s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-48332640-9ea9-4163-a94b-c46b6d06afb2 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:43 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-48332640-9ea9-4163-a94b-c46b6d06afb2 Jul 09 14:34:43 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:43 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84 1G" returned: 0 in 0.852s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:43 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:43 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84 Jul 09 14:34:43 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:44 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-48332640-9ea9-4163-a94b-c46b6d06afb2" returned: 0 in 0.638s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:44 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] Lock "cinder-quobyte-48332640-9ea9-4163-a94b-c46b6d06afb2" released by "delete_volume" :: held 1.550s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:44 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] Created reservations ['79cbce9a-c486-4e6e-8098-341631c32fb1', '8badabf3-b7c2-4ec8-97cd-beb1009afaae', '3bdf0d64-00f6-4b11-a257-b7ad26192b5a', 'd87a1339-6f27-493e-bfdc-e2d5903ea898'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:34:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:34:44 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:34:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:44 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:34:44 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:44 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84" returned: 0 in 0.711s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:44 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84 is being set with open permissions: ugo+rw Jul 09 14:34:44 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:44 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84 Jul 09 14:34:44 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:45 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.686s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:45 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:34:45 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] Deleted volume successfully. Jul 09 14:34:45 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84" returned: 0 in 0.671s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:45 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-abd36876-d7be-476e-8252-e0a400ea1cdf tempest-ProjectReaderTests-1319788490 None] Lock "cinder-48332640-9ea9-4163-a94b-c46b6d06afb2-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:45 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.info Jul 09 14:34:45 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:45 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.info" returned: 0 in 0.713s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:45 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.info is being set with open permissions: ugo+rw Jul 09 14:34:45 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:45 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.info Jul 09 14:34:45 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:46 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.info" returned: 0 in 0.690s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:46 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.518s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:46 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-72505d2d-31e9-4cff-ac6d-78bc3d49d013 tempest-ProjectMemberTests-1994606433 None] Create snapshot completed successfully Jul 09 14:34:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-11452a7c-d5b1-47e4-8293-59936887eb84-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-11452a7c-d5b1-47e4-8293-59936887eb84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-d35b4d03-8113-4c08-99d7-6cd91d22f6cb" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-d35b4d03-8113-4c08-99d7-6cd91d22f6cb" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-11452a7c-d5b1-47e4-8293-59936887eb84" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:47 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-11452a7c-d5b1-47e4-8293-59936887eb84" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] Deleting offline snapshot 11452a7c-d5b1-47e4-8293-59936887eb84 of volume d35b4d03-8113-4c08-99d7-6cd91d22f6cb {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:34:47 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] snapshot_file for this snap is: volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:34:47 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5151aad-de20-47fc-9841-5e6517fd11f2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:47 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:47 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84 Jul 09 14:34:47 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:48 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84" returned: 0 in 0.766s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:48 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:34:48 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00b57ad-7d5c-438a-8b8a-218762ef3a1b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:48 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb Jul 09 14:34:48 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:48 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb" returned: 0 in 0.712s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:48 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:48 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84 Jul 09 14:34:48 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:49 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84" returned: 0 in 0.704s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:49 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:49 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84 Jul 09 14:34:49 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:50 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb.11452a7c-d5b1-47e4-8293-59936887eb84" returned: 0 in 0.638s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:50 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-11452a7c-d5b1-47e4-8293-59936887eb84" released by "_delete_snapshot" :: held 2.900s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:50 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-d35b4d03-8113-4c08-99d7-6cd91d22f6cb" released by "delete_snapshot" :: held 2.920s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:50 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] Created reservations ['79d5f4d7-f9e4-4933-9e67-f892435771d5', 'dff641a5-d8b7-4e5c-ad53-cc297a955d7a', 'd9f34cc4-c896-4a26-86e8-9ff4cc2d2106', '63983c91-cd5c-422f-926c-b130890def88'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:34:50 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] Delete snapshot completed successfully. Jul 09 14:34:50 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-16f52444-0e58-429f-9a16-a68621e14c01 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-11452a7c-d5b1-47e4-8293-59936887eb84-delete_snapshot" released by "delete_snapshot" :: held 3.050s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:50 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-d35b4d03-8113-4c08-99d7-6cd91d22f6cb-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:50 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-d35b4d03-8113-4c08-99d7-6cd91d22f6cb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:50 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-d35b4d03-8113-4c08-99d7-6cd91d22f6cb" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:50 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-d35b4d03-8113-4c08-99d7-6cd91d22f6cb" acquired by "delete_volume" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:50 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85b887b-6e57-4db3-94a2-ac9a29df464c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:50 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:50 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb Jul 09 14:34:50 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:51 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb" returned: 0 in 0.772s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:51 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb Jul 09 14:34:51 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:51 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:51 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-d35b4d03-8113-4c08-99d7-6cd91d22f6cb" returned: 0 in 0.628s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:51 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-d35b4d03-8113-4c08-99d7-6cd91d22f6cb" released by "delete_volume" :: held 1.454s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:52 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] Created reservations ['6b738336-0034-411d-bf62-31d52f2d859b', 'bf5f19fb-d43c-4fa7-a8ab-f5737de2474b', 'db8f6dbd-ea4b-40f6-8c37-c83f8d715060', 'dd43069f-f8ef-46fe-ae37-a889c9f90389'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:34:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:34:52 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:34:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:52 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:34:52 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:52 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:52 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.629s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:52 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:34:52 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] Deleted volume successfully. Jul 09 14:34:52 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-e60dd6f7-fcc7-4d49-9f39-88b2453e9ac4 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-d35b4d03-8113-4c08-99d7-6cd91d22f6cb-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Flow 'volume_create_manager' (0f11edd4-9075-414b-b800-26664cf0bc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c86464d6-bb35-4134-8d67-48c18a011995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c86464d6-bb35-4134-8d67-48c18a011995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1512106408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74cae20c-a2b6-463b-96ed-7e4c79a10e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bba6e5fbe534bdf9f3e3459b1cd2d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:34:53Z,use_quota=True,user_id='d1e928af629b46fab523964aa23893c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39c3d2d-7b26-4910-b4a3-b984bf88dab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39c3d2d-7b26-4910-b4a3-b984bf88dab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e35ac811-b6f3-48a8-9b4e-4b59e401134a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e35ac811-b6f3-48a8-9b4e-4b59e401134a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74cae20c-a2b6-463b-96ed-7e4c79a10e04', 'volume_name': 'volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93afdfe-1af9-44c2-8fae-41941bd2f3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93afdfe-1af9-44c2-8fae-41941bd2f3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4818a3-25a5-4828-904d-7befd0270e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:53 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Volume 74cae20c-a2b6-463b-96ed-7e4c79a10e04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04', 'volume_size': 1} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1512106408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74cae20c-a2b6-463b-96ed-7e4c79a10e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bba6e5fbe534bdf9f3e3459b1cd2d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:34:53Z,use_quota=True,user_id='d1e928af629b46fab523964aa23893c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Creating volume 74cae20c-a2b6-463b-96ed-7e4c79a10e04 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:34:53 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:53 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04 1073741824 Jul 09 14:34:53 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:53 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:53 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04 1073741824" returned: 0 in 0.802s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:54 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04 Jul 09 14:34:54 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:54 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04" returned: 0 in 0.637s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:54 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:34:54 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4818a3-25a5-4828-904d-7befd0270e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd0a7b9-28bc-4e2e-9d3b-d26dff517d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:34:54 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Volume volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04 (74cae20c-a2b6-463b-96ed-7e4c79a10e04): created successfully Jul 09 14:34:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd0a7b9-28bc-4e2e-9d3b-d26dff517d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:34:54 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Flow 'volume_create_manager' (0f11edd4-9075-414b-b800-26664cf0bc9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:34:54 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-c813abad-ec77-471e-90ea-7fd52467f559 tempest-ProjectMemberTests-1994606433 None] Created volume successfully. Jul 09 14:34:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:34:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:34:55 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] Creating offline snapshot 39c7050e-2a76-4702-ac25-ff17e52d7dfd of volume 74cae20c-a2b6-463b-96ed-7e4c79a10e04 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:34:55 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[391b556d-ce27-4a63-a06d-7bfff209844b]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:55 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:55 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04 Jul 09 14:34:55 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:56 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04" returned: 0 in 0.715s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:56 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd 1G Jul 09 14:34:56 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:56 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd 1G" returned: 0 in 0.741s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:56 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd Jul 09 14:34:56 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:57 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd" returned: 0 in 0.643s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:57 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd is being set with open permissions: ugo+rw Jul 09 14:34:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:57 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd Jul 09 14:34:57 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:58 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd" returned: 0 in 0.616s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:58 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.info Jul 09 14:34:58 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:58 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.info" returned: 0 in 0.605s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:58 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.info is being set with open permissions: ugo+rw Jul 09 14:34:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:58 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.info Jul 09 14:34:58 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:34:59 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jul 09 14:34:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.info" returned: 0 in 0.615s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:34:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.013s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:34:59 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-9f2bad2c-b6e3-48b1-b6af-62f93d4d890b tempest-ProjectMemberTests-1994606433 None] Create snapshot completed successfully Jul 09 14:34:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-39c7050e-2a76-4702-ac25-ff17e52d7dfd-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] Lock "cinder-39c7050e-2a76-4702-ac25-ff17e52d7dfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-74cae20c-a2b6-463b-96ed-7e4c79a10e04" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-74cae20c-a2b6-463b-96ed-7e4c79a10e04" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-39c7050e-2a76-4702-ac25-ff17e52d7dfd" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:34:59 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-39c7050e-2a76-4702-ac25-ff17e52d7dfd" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:34:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] Deleting offline snapshot 39c7050e-2a76-4702-ac25-ff17e52d7dfd of volume 74cae20c-a2b6-463b-96ed-7e4c79a10e04 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:34:59 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] snapshot_file for this snap is: volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:34:59 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a875fa3-6963-4a31-8ec9-fcbd6ea55ea0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:34:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:34:59 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd Jul 09 14:34:59 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:00 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd" returned: 0 in 0.715s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:00 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:35:00 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0834a97-c796-49ad-9428-14cd31b679c8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:35:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:00 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04 Jul 09 14:35:00 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:01 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04" returned: 0 in 0.704s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:01 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd Jul 09 14:35:01 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:01 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd" returned: 0 in 0.707s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:01 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd Jul 09 14:35:01 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:02 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04.39c7050e-2a76-4702-ac25-ff17e52d7dfd" returned: 0 in 0.601s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-39c7050e-2a76-4702-ac25-ff17e52d7dfd" released by "_delete_snapshot" :: held 2.813s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:35:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-74cae20c-a2b6-463b-96ed-7e4c79a10e04" released by "delete_snapshot" :: held 2.832s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:35:02 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] Created reservations ['e828ba63-4541-499e-b586-b03d0849e0e0', '9a15069a-0f1d-4e97-b15b-7403315e1287', 'bf62d7ea-6813-43ec-8ee3-1179ab03f35e', '667870ae-c613-4885-aea3-6a55bd1efdda'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:35:02 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] Delete snapshot completed successfully. Jul 09 14:35:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-61ed0380-811b-428f-8f4c-9c020ef01b9c tempest-ProjectMemberTests-1994606433 None] Lock "cinder-39c7050e-2a76-4702-ac25-ff17e52d7dfd-delete_snapshot" released by "delete_snapshot" :: held 2.962s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:35:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-74cae20c-a2b6-463b-96ed-7e4c79a10e04-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:35:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-74cae20c-a2b6-463b-96ed-7e4c79a10e04-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:35:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-74cae20c-a2b6-463b-96ed-7e4c79a10e04" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:35:02 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-74cae20c-a2b6-463b-96ed-7e4c79a10e04" acquired by "delete_volume" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:35:02 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca2d1d7-f88b-49f2-ba29-e6bb1dc3e304]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:35:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:02 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04 Jul 09 14:35:02 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:03 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04" returned: 0 in 0.775s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:03 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04 Jul 09 14:35:03 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:04 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-74cae20c-a2b6-463b-96ed-7e4c79a10e04" returned: 0 in 0.654s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-74cae20c-a2b6-463b-96ed-7e4c79a10e04" released by "delete_volume" :: held 1.484s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:35:04 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] Created reservations ['3f5875f8-d2ae-42db-831e-ade2ec071023', '119df9ef-65f9-4e69-a107-1471e8f2833f', '9416e527-b5ba-45af-bfa6-2a5b84e8e858', '98f2e7c9-dd4f-415c-acc5-d3fe97ee1d42'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:35:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:35:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:35:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:35:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:35:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:35:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:04 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:35:04 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:05 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.651s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:35:05 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] Deleted volume successfully. Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-64284877-dbc2-4897-acea-7cef5c9356a9 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-74cae20c-a2b6-463b-96ed-7e4c79a10e04-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Flow 'volume_create_manager' (74263061-5919-41e3-8b7c-6d6a55da8f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7756e365-3056-4bcd-aee3-135690d0f4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7756e365-3056-4bcd-aee3-135690d0f4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1608791374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=446d3f1f-0f03-4cfd-92ad-4ad0493da36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bba6e5fbe534bdf9f3e3459b1cd2d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:35:05Z,use_quota=True,user_id='d1e928af629b46fab523964aa23893c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34cba266-c360-41cd-9370-74a5c053e6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34cba266-c360-41cd-9370-74a5c053e6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417a2668-959c-4734-9559-c47f318d14d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417a2668-959c-4734-9559-c47f318d14d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '446d3f1f-0f03-4cfd-92ad-4ad0493da36f', 'volume_name': 'volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a3437e-cab2-4bab-895f-4030848fa213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a3437e-cab2-4bab-895f-4030848fa213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c62a95-85ed-4a97-b4ef-6b6f1630d32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:35:05 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Volume 446d3f1f-0f03-4cfd-92ad-4ad0493da36f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f', 'volume_size': 1} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1608791374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=446d3f1f-0f03-4cfd-92ad-4ad0493da36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bba6e5fbe534bdf9f3e3459b1cd2d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:35:05Z,use_quota=True,user_id='d1e928af629b46fab523964aa23893c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Creating volume 446d3f1f-0f03-4cfd-92ad-4ad0493da36f {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:35:05 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:35:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:05 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f 1073741824 Jul 09 14:35:05 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:06 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f 1073741824" returned: 0 in 0.882s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:06 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f Jul 09 14:35:06 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:06 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f" returned: 0 in 0.605s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:06 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:35:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:35:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c62a95-85ed-4a97-b4ef-6b6f1630d32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:35:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b35a120-6ff3-43f8-919c-1a13889506b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:35:07 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Volume volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f (446d3f1f-0f03-4cfd-92ad-4ad0493da36f): created successfully Jul 09 14:35:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b35a120-6ff3-43f8-919c-1a13889506b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:35:07 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Flow 'volume_create_manager' (74263061-5919-41e3-8b7c-6d6a55da8f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:35:07 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-f4ebe9b3-2c7b-4e1d-bea4-fc333291f324 tempest-ProjectMemberTests-1994606433 None] Created volume successfully. Jul 09 14:35:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:35:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:35:07 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] Creating offline snapshot 78cc144a-129b-4339-bed9-ea7d3730067c of volume 446d3f1f-0f03-4cfd-92ad-4ad0493da36f {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:35:07 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[a619843b-2fc5-4aea-bea5-06ce008c54e0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:35:07 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:07 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f Jul 09 14:35:07 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:08 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f" returned: 0 in 0.768s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:08 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:08 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c 1G Jul 09 14:35:08 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:09 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c 1G" returned: 0 in 0.790s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:09 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c Jul 09 14:35:09 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:09 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c" returned: 0 in 0.687s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:09 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c is being set with open permissions: ugo+rw Jul 09 14:35:09 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:09 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c Jul 09 14:35:09 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:10 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c" returned: 0 in 0.608s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:10 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.info Jul 09 14:35:10 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:11 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.info" returned: 0 in 0.652s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:11 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.info is being set with open permissions: ugo+rw Jul 09 14:35:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:11 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.info Jul 09 14:35:11 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:11 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.info" returned: 0 in 0.618s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.224s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:35:11 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-7ec6141f-0d2d-473d-837e-5600896dc1aa tempest-ProjectMemberTests-1994606433 None] Create snapshot completed successfully Jul 09 14:35:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:35:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:35:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:35:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:35:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:35:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:35:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:12 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:35:12 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:13 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.620s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:35:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:35:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:35:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:35:15 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-78cc144a-129b-4339-bed9-ea7d3730067c-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:35:15 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-78cc144a-129b-4339-bed9-ea7d3730067c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:35:15 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-446d3f1f-0f03-4cfd-92ad-4ad0493da36f" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:35:15 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-446d3f1f-0f03-4cfd-92ad-4ad0493da36f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:35:15 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-78cc144a-129b-4339-bed9-ea7d3730067c" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:35:15 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-78cc144a-129b-4339-bed9-ea7d3730067c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:35:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] Deleting offline snapshot 78cc144a-129b-4339-bed9-ea7d3730067c of volume 446d3f1f-0f03-4cfd-92ad-4ad0493da36f {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:35:15 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] snapshot_file for this snap is: volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:35:15 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a716141-0dcc-4eeb-b022-dfdc3abdc81c]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:35:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:15 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c Jul 09 14:35:15 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:16 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c" returned: 0 in 0.711s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:16 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:35:16 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bddbac3-57ca-4644-9be6-2cf17fa7e070]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:35:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:16 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f Jul 09 14:35:16 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:17 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f" returned: 0 in 0.717s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:17 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c Jul 09 14:35:17 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:17 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c" returned: 0 in 0.718s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:17 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c Jul 09 14:35:17 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:18 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f.78cc144a-129b-4339-bed9-ea7d3730067c" returned: 0 in 0.635s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-78cc144a-129b-4339-bed9-ea7d3730067c" released by "_delete_snapshot" :: held 2.865s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:35:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-446d3f1f-0f03-4cfd-92ad-4ad0493da36f" released by "delete_snapshot" :: held 2.885s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:35:18 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] Created reservations ['22590ea9-d0f1-4097-b474-d7e050e421d8', '76277975-f721-472b-85ad-e57a3d82ae5c', 'cdf930a0-850d-48ce-aaa5-707dc84ecb83', '32ce7339-a8da-4a46-8df0-e09adc4685ea'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:35:18 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] Delete snapshot completed successfully. Jul 09 14:35:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-86a2d4ea-fa7b-4041-8c7d-8b3e876f67e5 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-78cc144a-129b-4339-bed9-ea7d3730067c-delete_snapshot" released by "delete_snapshot" :: held 3.019s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:35:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-446d3f1f-0f03-4cfd-92ad-4ad0493da36f-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:35:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-446d3f1f-0f03-4cfd-92ad-4ad0493da36f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:35:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "cinder-quobyte-446d3f1f-0f03-4cfd-92ad-4ad0493da36f" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:35:18 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-446d3f1f-0f03-4cfd-92ad-4ad0493da36f" acquired by "delete_volume" :: waited 0.019s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:35:18 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6e73e0-cfe3-4df0-ac0c-ca423fc167d9]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:35:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:18 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f Jul 09 14:35:18 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:19 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f" returned: 0 in 0.735s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:19 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f Jul 09 14:35:19 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:20 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-446d3f1f-0f03-4cfd-92ad-4ad0493da36f" returned: 0 in 0.642s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:20 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-quobyte-446d3f1f-0f03-4cfd-92ad-4ad0493da36f" released by "delete_volume" :: held 1.432s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:35:20 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] Created reservations ['e31d2d71-0e46-44ac-a28f-24ee95a46511', '27e16131-a4e2-4119-b68b-fdb3085a22d3', '562111df-24b1-4b1d-9f74-1ef886f0108f', '825d463f-893d-4702-b34a-204775b7b4d3'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:35:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:35:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:35:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:35:20 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:35:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:35:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:20 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:35:20 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:21 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.616s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:21 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:35:21 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] Deleted volume successfully. Jul 09 14:35:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-665fcf86-b9e9-45b4-951e-502084d9cd08 tempest-ProjectMemberTests-1994606433 None] Lock "cinder-446d3f1f-0f03-4cfd-92ad-4ad0493da36f-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:35:30 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=68,cinder:INSERT=28,cinder:UPDATE=85,cinder:DELETE=4 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:35:31 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:INSERT=20,cinder:UPDATE=95,cinder:SELECT=62,cinder:DELETE=10 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Flow 'volume_create_manager' (b0391a82-c39d-4ed7-8de3-be15bd7d8f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74f60b8-6291-4e27-bac9-4d349e72432b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74f60b8-6291-4e27-bac9-4d349e72432b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1425996610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3734e977-44b8-484e-8f15-2481c7141f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e10d3a258d714786917feb26ebdba442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:35:57Z,use_quota=True,user_id='b16369aad9074423a5e72cb62e9a9101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e142ade-92a6-4bc8-91dd-94dd4f8d1fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e142ade-92a6-4bc8-91dd-94dd4f8d1fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60fb323-8aa7-4ce7-aeb0-51ce8ef2e8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60fb323-8aa7-4ce7-aeb0-51ce8ef2e8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3734e977-44b8-484e-8f15-2481c7141f91', 'volume_name': 'volume-3734e977-44b8-484e-8f15-2481c7141f91', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ace168-22ba-47ab-90cf-07a90d82c0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ace168-22ba-47ab-90cf-07a90d82c0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9c336e-ce19-437c-9215-f4292dc7a3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:35:56 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Volume 3734e977-44b8-484e-8f15-2481c7141f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3734e977-44b8-484e-8f15-2481c7141f91', 'volume_size': 1} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1425996610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3734e977-44b8-484e-8f15-2481c7141f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e10d3a258d714786917feb26ebdba442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:35:57Z,use_quota=True,user_id='b16369aad9074423a5e72cb62e9a9101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)}" {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Creating volume 3734e977-44b8-484e-8f15-2481c7141f91 {{(pid=87011) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:35:56 devstack cinder-volume[87011]: INFO cinder.volume.drivers.remotefs [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] casted to osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 Jul 09 14:35:56 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 1073741824 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:56 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 1073741824 Jul 09 14:35:56 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:57 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 1073741824" returned: 0 in 0.789s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:57 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:57 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 Jul 09 14:35:57 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:58 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91" returned: 0 in 0.621s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'} {{(pid=87011) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 14:35:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:35:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9c336e-ce19-437c-9215-f4292dc7a3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3734e977-44b8-484e-8f15-2481c7141f91', 'volume_size': 1}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:35:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a18a2b-2977-45da-a484-6381e7e7b17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:35:58 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Volume volume-3734e977-44b8-484e-8f15-2481c7141f91 (3734e977-44b8-484e-8f15-2481c7141f91): created successfully Jul 09 14:35:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a18a2b-2977-45da-a484-6381e7e7b17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:35:58 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Flow 'volume_create_manager' (b0391a82-c39d-4ed7-8de3-be15bd7d8f73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:35:58 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-534dd8d3-62ce-4f55-8e83-20ee778e3d7f tempest-SnapshotDependencyTests-1552911024 None] Created volume successfully. Jul 09 14:35:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:35:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:35:58 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] Creating offline snapshot e3771bf8-951a-4f71-a262-5e04dc670b09 of volume 3734e977-44b8-484e-8f15-2481c7141f91 {{(pid=87011) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 14:35:58 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[457a5eb2-1eca-466d-9695-1377b94599e1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:35:58 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:58 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 Jul 09 14:35:58 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:35:59 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Jul 09 14:35:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91" returned: 0 in 0.723s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:35:59 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09 1G {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:35:59 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09 1G Jul 09 14:35:59 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:00 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09 1G" returned: 0 in 0.764s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:00 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3734e977-44b8-484e-8f15-2481c7141f91 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:00 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3734e977-44b8-484e-8f15-2481c7141f91 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09 Jul 09 14:36:00 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:01 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3734e977-44b8-484e-8f15-2481c7141f91 -F qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09" returned: 0 in 0.697s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:01 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09 is being set with open permissions: ugo+rw Jul 09 14:36:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:01 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09 Jul 09 14:36:01 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:01 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09" returned: 0 in 0.656s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:01 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:01 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.info Jul 09 14:36:01 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:02 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.info" returned: 0 in 0.635s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:02 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.info is being set with open permissions: ugo+rw Jul 09 14:36:02 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.info {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:02 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.info Jul 09 14:36:02 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:03 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.info" returned: 0 in 0.616s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:03 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.167s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:36:03 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-3a655b00-c972-4b2a-bce5-f0ff39c6f191 tempest-SnapshotDependencyTests-1552911024 None] Create snapshot completed successfully Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.volume.flows.manager.create_volume [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87011) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Flow 'volume_create_manager' (b21a08af-cf95-48fe-8228-8ee33c8e6eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d76845-27bf-42f6-ae15-37dc2e61e686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d76845-27bf-42f6-ae15-37dc2e61e686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T12:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f5ba29-58cc-451d-9a5b-bb4d65b9a40b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e10d3a258d714786917feb26ebdba442',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T12:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3771bf8-951a-4f71-a262-5e04dc670b09,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T12:36:05Z,use_quota=True,user_id='b16369aad9074423a5e72cb62e9a9101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15d78fab-3a16-4373-926a-343dffd8b565),volume_type_id=15d78fab-3a16-4373-926a-343dffd8b565)' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58be122-42a5-4a11-b349-bddfadfefdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58be122-42a5-4a11-b349-bddfadfefdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dceb04f-2fda-48df-8cfe-d12ffcd06112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dceb04f-2fda-48df-8cfe-d12ffcd06112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '82f5ba29-58cc-451d-9a5b-bb4d65b9a40b', 'volume_name': 'volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b', 'volume_size': 1, 'snapshot_id': 'e3771bf8-951a-4f71-a262-5e04dc670b09'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e95e79-3690-435d-b60f-17704f6af7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e95e79-3690-435d-b60f-17704f6af7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695c5c25-4545-4177-b543-09f6a1b5e02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:36:04 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Volume 82f5ba29-58cc-451d-9a5b-bb4d65b9a40b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b', 'volume_size': 1, 'snapshot_id': 'e3771bf8-951a-4f71-a262-5e04dc670b09'} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Acquiring lock "cinder-quobyte-e3771bf8-951a-4f71-a262-5e04dc670b09-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b" by "_create_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Lock "cinder-quobyte-e3771bf8-951a-4f71-a262-5e04dc670b09-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Creating volume 82f5ba29-58cc-451d-9a5b-bb4d65b9a40b from snapshot e3771bf8-951a-4f71-a262-5e04dc670b09 {{(pid=87011) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Selected osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610 as target Quobyte volume. {{(pid=87011) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Acquiring lock "cinder-quobyte-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b" by "_copy_volume_from_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Lock "cinder-quobyte-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] snapshot: e3771bf8-951a-4f71-a262-5e04dc670b09, volume: 82f5ba29-58cc-451d-9a5b-bb4d65b9a40b, {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[4372ce7f-1819-4ee8-9b52-5c25be27ec55]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:36:04 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:04 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09 Jul 09 14:36:04 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:05 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09" returned: 0 in 0.712s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3734e977-44b8-484e-8f15-2481c7141f91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:36:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 14:36:05 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Creating direct copy from snapshot {{(pid=87011) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 14:36:05 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[d422d236-d767-4528-8936-699b7f4c6db0]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:36:05 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:05 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 Jul 09 14:36:05 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:06 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91" returned: 0 in 0.781s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:06 devstack cinder-volume[87011]: DEBUG cinder.utils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Path /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b not found in is_blk_device check {{(pid=87011) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 14:36:06 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:06 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b Jul 09 14:36:06 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:10 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b" returned: 0 in 4.222s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:10 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90c9c6b-7a21-498a-8ce7-fc29846511e2]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:36:10 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:10 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 Jul 09 14:36:10 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:11 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91" returned: 0 in 0.983s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:11 devstack cinder-volume[87011]: DEBUG cinder.image.image_utils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Image conversion details: src /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91, size 1024.00 MB, duration 4.22 sec, destination /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b {{(pid=87011) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 14:36:11 devstack cinder-volume[87011]: INFO cinder.image.image_utils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Converted 1024.00 MB image at 242.46 MB/s Jul 09 14:36:11 devstack cinder-volume[87011]: WARNING cinder.volume.drivers.remotefs [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b is being set with open permissions: ugo+rw Jul 09 14:36:11 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:11 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b Jul 09 14:36:11 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:12 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b" returned: 0 in 0.641s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Lock "cinder-quobyte-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b" released by "_copy_volume_from_snapshot" :: held 7.428s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:36:12 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Lock "cinder-quobyte-e3771bf8-951a-4f71-a262-5e04dc670b09-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b" released by "_create_volume_from_snapshot" :: held 7.454s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:36:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.470s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:36:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (695c5c25-4545-4177-b543-09f6a1b5e02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b', 'volume_size': 1, 'snapshot_id': 'e3771bf8-951a-4f71-a262-5e04dc670b09'}' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:36:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443ed938-4fbe-4266-a600-d6951792eab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 14:36:12 devstack cinder-volume[87011]: INFO cinder.volume.flows.manager.create_volume [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Volume volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b (82f5ba29-58cc-451d-9a5b-bb4d65b9a40b): created successfully Jul 09 14:36:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443ed938-4fbe-4266-a600-d6951792eab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87011) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 14:36:12 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Flow 'volume_create_manager' (b21a08af-cf95-48fe-8228-8ee33c8e6eff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87011) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 14:36:12 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-f114489e-25e8-406e-88ed-de51f9aec4f6 tempest-SnapshotDependencyTests-1552911024 None] Created volume successfully. Jul 09 14:36:12 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:36:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:36:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:36:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:36:12 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:36:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:36:12 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:12 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:36:12 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:13 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.634s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:13 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:36:13 devstack cinder-volume[87011]: DEBUG oslo_service.periodic_task [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] Running periodic task VolumeManager._thread_info {{(pid=87011) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 14:36:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread count: 28 {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 14:36:13 devstack cinder-volume[87011]: DEBUG cinder.volume.manager [None req-f7fb505c-6329-441d-8746-08e9fbf174fe None None] thread info: [<_MainThread(MainThread, started 139985211277440)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87011) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 14:36:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] Acquiring lock "cinder-e3771bf8-951a-4f71-a262-5e04dc670b09-delete_snapshot" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:36:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] Lock "cinder-e3771bf8-951a-4f71-a262-5e04dc670b09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:36:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] Acquiring lock "cinder-quobyte-3734e977-44b8-484e-8f15-2481c7141f91" by "delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:36:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] Lock "cinder-quobyte-3734e977-44b8-484e-8f15-2481c7141f91" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:36:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] Acquiring lock "cinder-quobyte-e3771bf8-951a-4f71-a262-5e04dc670b09" by "_delete_snapshot" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:36:13 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] Lock "cinder-quobyte-e3771bf8-951a-4f71-a262-5e04dc670b09" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:36:13 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] Deleting offline snapshot e3771bf8-951a-4f71-a262-5e04dc670b09 of volume 3734e977-44b8-484e-8f15-2481c7141f91 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 14:36:13 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] snapshot_file for this snap is: volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09 {{(pid=87011) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 14:36:13 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cd47d2-29f1-4eb0-b9dd-23cba54ef1c8]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:36:13 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:13 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09 Jul 09 14:36:13 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:14 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09" returned: 0 in 0.730s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:14 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.remotefs [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3734e977-44b8-484e-8f15-2481c7141f91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87011) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 14:36:14 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89088af-d41a-421a-83d6-cd629be7245f]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:36:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:14 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 Jul 09 14:36:14 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:14 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91" returned: 0 in 0.755s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:14 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:14 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09 Jul 09 14:36:14 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:15 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09" returned: 0 in 0.828s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:15 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:15 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09 Jul 09 14:36:15 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:16 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:16 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91.e3771bf8-951a-4f71-a262-5e04dc670b09" returned: 0 in 0.687s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] Lock "cinder-quobyte-e3771bf8-951a-4f71-a262-5e04dc670b09" released by "_delete_snapshot" :: held 3.100s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:36:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] Lock "cinder-quobyte-3734e977-44b8-484e-8f15-2481c7141f91" released by "delete_snapshot" :: held 3.124s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:36:16 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] Created reservations ['b26c642c-e7bc-408f-86a2-e13693b39d2d', 'a2720ace-3c31-4281-a145-43439b0d7ef4', '35d4099e-c4d5-4e05-a2e8-af3615df1582', 'e1e99b91-34ec-4618-91d5-ed0f999c0f3e'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:36:16 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] Delete snapshot completed successfully. Jul 09 14:36:16 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-4f36e9e4-7616-471b-a90f-a7c0eefa1db2 tempest-SnapshotDependencyTests-1552911024 None] Lock "cinder-e3771bf8-951a-4f71-a262-5e04dc670b09-delete_snapshot" released by "delete_snapshot" :: held 3.272s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:36:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] Acquiring lock "cinder-3734e977-44b8-484e-8f15-2481c7141f91-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:36:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] Lock "cinder-3734e977-44b8-484e-8f15-2481c7141f91-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:36:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] Acquiring lock "cinder-quobyte-3734e977-44b8-484e-8f15-2481c7141f91" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:36:17 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] Lock "cinder-quobyte-3734e977-44b8-484e-8f15-2481c7141f91" acquired by "delete_volume" :: waited 0.016s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:36:17 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f25a9d-9300-45f5-957d-727e1be7f1c1]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:36:17 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:17 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 Jul 09 14:36:17 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:18 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91" returned: 0 in 0.771s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:18 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:18 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91 Jul 09 14:36:18 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:19 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-3734e977-44b8-484e-8f15-2481c7141f91" returned: 0 in 0.645s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] Lock "cinder-quobyte-3734e977-44b8-484e-8f15-2481c7141f91" released by "delete_volume" :: held 1.472s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:36:19 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] Created reservations ['ea74c23c-05db-4326-ba42-ea5125a2c09c', '1bc1fc0c-4eca-4eb5-a43c-5e8beeb23d3a', 'e394a426-f265-4aab-882d-3daf260d6ab9', '6d92bc85-59b7-4b53-bcd6-5acc415830ad'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:36:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:36:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:36:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:36:19 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:36:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:36:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:19 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:36:19 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] Acquiring lock "cinder-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b-delete_volume" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:36:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] Lock "cinder-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:36:19 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.633s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:19 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:36:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] Acquiring lock "cinder-quobyte-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b" by "delete_volume" {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 14:36:19 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] Deleted volume successfully. Jul 09 14:36:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] Lock "cinder-quobyte-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b" acquired by "delete_volume" :: waited 0.024s {{(pid=87011) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 14:36:19 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-64eae72c-bf2f-4918-af0f-a58ad3ddcc29 tempest-SnapshotDependencyTests-1552911024 None] Lock "cinder-3734e977-44b8-484e-8f15-2481c7141f91-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:36:19 devstack cinder-volume[87011]: DEBUG oslo.privsep.daemon [-] privsep: reply[958e3478-e1e2-4f31-b967-7025b7afcca6]: (4, 'qcow2') {{(pid=88269) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 14:36:19 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:20 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b Jul 09 14:36:20 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:20 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b" returned: 0 in 0.752s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:20 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:20 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b Jul 09 14:36:20 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:21 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea/volume-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b" returned: 0 in 0.652s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:21 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] Lock "cinder-quobyte-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b" released by "delete_volume" :: held 1.446s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:36:21 devstack cinder-volume[87011]: DEBUG cinder.quota [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] Created reservations ['385788bd-a060-4286-aa7b-1366f1f5568f', 'a3d7b47f-d461-4fd4-afd6-5dbebadf33f7', 'cbd51f53-a575-46b3-9a10-69d3cdd9ddef', '017e5141-a004-4c88-bbbc-fa69280132bb'] {{(pid=87011) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 14:36:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 14:36:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 14:36:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610': None} {{(pid=87011) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 14:36:21 devstack cinder-volume[87011]: DEBUG cinder.volume.drivers.quobyte [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6303c5a4-0219-4766-a255-81e32cf1e610'] {{(pid=87011) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 14:36:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.lockutils [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87011) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 14:36:21 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 14:36:21 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea Jul 09 14:36:21 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 14:36:22 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Jul 09 14:36:22 devstack cinder-volume[87011]: DEBUG oslo_concurrency.processutils [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3c73aaeefc3d01142aa1cbef7ffc68ea" returned: 0 in 0.612s {{(pid=87011) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 14:36:22 devstack cinder-volume[87011]: DEBUG cinder.manager [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] Notifying Schedulers of capabilities ... {{(pid=87011) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 14:36:22 devstack cinder-volume[87011]: INFO cinder.volume.manager [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] Deleted volume successfully. Jul 09 14:36:22 devstack cinder-volume[87011]: DEBUG cinder.coordination [None req-ad8a8a39-8fbf-44aa-8923-410f3a27cf49 tempest-SnapshotDependencyTests-1552911024 None] Lock "cinder-82f5ba29-58cc-451d-9a5b-bb4d65b9a40b-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=87011) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 14:36:31 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:SELECT=24,cinder:UPDATE=31,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 14:36:32 devstack cinder-volume[87011]: DEBUG dbcounter [-] [87011] Writing DB stats cinder:UPDATE=25,cinder:SELECT=23,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87011) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}